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16.  Abffrocf 

NT SB  accident  data  Indicate  that  low-time,  non- Instrument  rated  general  aviation 
pilots  are  disproportionately  Involved  In  fatal  weather- related  accidents.  In  view 
of  the  existing  200-hour  experience  requirement  (FAR  61.65)  for  an  Instrument  rating, 
some  150  hours  of  flight  time  must  be  accumulated  between  Private  Pilot  Certification 
and  issuance  of  the  rating.  During  this  period  there  Is  a  fairly  high  probability  of 
encountering  weather  conditions  that  present  task  demands  which  exceed  the  capabil¬ 
ities  of  the  pilot.  Suggestions  have  been  made  to  reduce  the  200-hour  requirement  In 
the  hope  that  earlier  Instrument  training  would  be  sought,  thereby  reducing  these 
accidents. 

The  study  reported  here  examined  the  relationship  of  pilot  experience  to  the  acquisi¬ 
tion  of  instrument  flight  skills.  Seventy-nine  Embry-Riddle  Aeronautical  University 
students  were  assigned  to  one  of  three  experimental  training  groups  In  which  a  full 
program  of  private,  Instrument,  and  commercial  pilot  training  was  administered. 
Prior  to  taking  their  Instrument  checkrldes,  the  groups  had  113,  138,  and  171  mean 
hours  of  flight  time,  respectively.  Inflight  performance  was  assessed  objectively 
and  subjectively.  No  statistically  significant  differences  were  found  among  tracks 
In  Instrument  flying  skill. 

Results  suggest  that  a  reduction  In  the  200-hour  experience  requirement  should  be 
considered.  Such  a  reduction  would  encourage  earlier  training  of  Instrument  ski lj) s 
and  could  reduce  the  weather-related  accident  rate  for  low- time  private  pilots.  -X 1 
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EXECUTIVE  SUMMARY 


One  of  the  most  Important  considerations  In  the  attempt  to  Improve  general 
aviation  safety  Is  the  necessity  for  general  aviation  pilots  to  operate  In  a 
wide  range  of  degraded  weather  conditions.  A  review  of  National 
Transportation  Safety  Board  ( NTSB )  weather- related  accident  data  Indicates 
that  such  conditions  are  significant  factors  In  general  aviation  pilot  safety 
and  efficiency.  A  disproportionate  number  of  fatal  and  non-fatal  weather- 
related  accidents  have  Involved  pilots  with  fewer  than  200  hours  of  total  time 
and  little  or  no  Instrument  training. 

Because  of  the  relatively  high  rate  of  Involvement  of  low  time,  non- Instrument 
rated  pilots  In  weather- related  accidents,  there  Is  a  growing  concern  that  a 
training  problem  exists  relative  to  current  FAA  instrument  rating  require¬ 
ments.  For  example,  many  non-instrument  rated  private  pilots  delay  commencing 
instrument  training  until  they  have  accumulated  some  150-160  hours  of  flight 
time.  An  unfortunate  consequence  of  this  practice  Is  that  because  these 
pilots  do  not  actively  pursue  the  instrument  rating  prior  to  the  150  hour 
level,  they  do  not  acquire  the  instrument  flying  skills  necessary  to  operate 
safely  within  the  variety  of  degraded  weather  conditions  that  many  of  them 
encounter  either  deliberately  or  nondel iberately.  It  is  such  encounters  that 
often  comprise  "continued  VFR  operations  In  IFR  conditions"  as  a  causal  or 
contributing  factor  In  weather- related  accidents.  Therefore,  a  practical  and 
empirical  question  has  been  raised  concerning  the  advisability  of  reducing  the 
200-hour  total  flight  time  requirement  for  obtaining  the  Instrument  rating. 
In  view  of  these  considerations  an  experimental  investigation  was  conducted  to 
gather  information  relevant  to  this  question.  The  experiment  was  carried  out 
jointly  by  Embry-Riddle  Aeronautical  University  (E-RAU),  Daytona  Beach, 
Florida,  and  the  Seville  Research  Corporation,  Pensacola,  Florida.  The  effort 
was  sponsored  by  the  Federal  Aviation  Administration  (FAA)  Technical  Center 
and  the  FAA  Office  of  Systems  Engineering  Management,  and  was  monitored  by  the 
FAA  Office  of  Flight  Operations. 

OBJECTIVES. 

The  primary  objective  of  the  experiment  reported  here  was  to  examine  the  rela¬ 
tionship  of  pilot  experience,  as  defined  by  total  flight  time,  to  the  acquisi¬ 
tion  of  Instrument  flight  skills  as  demonstrated  by  performance  on  the 
instrument  checkrlde.  Secondary  objectives  were  to  (1)  Identify  and  assess 
specific  Instrument  maneuver  performance  differences  by  student  pilots  whose 
total  flight  times  ranged  between  100  and  200  hours,  and  (2)  determine  whether 
differences  In  total  flight  time  affected  the  general  process  by  which  daily 
instrunent  flying  skills  were  learned. 

METHOD. 

The  experiment  was  carried  out  utilizing  E-RAU  students  and  training  facili¬ 
ties.  Three  experimental  training  groups  (A,  B,  and  C)  were  constituted  from 
E-RAU  student  volunteers.  Each  group  received  standard  Instrument  training 
after  varying  amounts  of  total  flight  experience.  Group  A  began  Its  Instru¬ 
ment  training  after  67  hours.  Group  B  after  100  hours,  and  Group  C  after  130 
hours  of  total  flight  experience.  Each  group  was  then  a&nlnlstered  a 
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standardized  Instrument  checkrlde  after  completion  of  their  Instrument 
training.  A  total  of  96  subjects,  all  without  any  previous  flight  experience, 
began  the  program.  Of  these,  79  subjects  completed  Instrument  training  (27  In 
Track  A,  26  In  Track  B,  and  26  In  Track  C) . 

Because  this  study  was  intended  to  address  factors  pertaining  only  to 
experience  as  defined  by  number  of  flight  hours,  the  content  and  sequence  of 
training  for  experimental  tracks  were  controlled  to  the  greatest  possible 
extent.  Further,  the  content  and  sequence  of  instrument  training  Itself  were 
standard  across  tracks.  The  experimental  design  called  for  three  sets  of  data 
for  each  track:  (1)  measures  of  flight  proficiency  on  a  contact  checkrlde 
administered  prior  to  Instrument  training;  (2)  dally  progress  measures  admin¬ 
istered  during  Instrument  training;  and  (3)  measures  of  flight  proficiency  on 
an  instrument  checkrlde  administered  upon  completion  of  Instrument  training. 
Objective,  inflight,  data  collection  forms  were  used  to  gather  these  data. 

In  addition  to  the  objective  measures  of  checkrlde  performance,  provision  was 
made  for  checkpllots  to  assign,  on  a  subjective  basis,  a  letter  grade  to  the 
performance  of  each  maneuver  by  each  student  on  both  contact  and  instrument 
checkrldes.  Letter  grades  also  were  to  be  assigned  to  each  of  four  "flight 
quality"  dimensions  describing  overall  checkrlde  performance. 

The  checkpllots  underwent  a  carefully  defined  and  supervised  six-day  training 
program.  All  procedures  followed  by  checkpllots  when  recording  data  were 
standardized.  Eight  checkpllots  and  13  Instructors  were  Involved  in  the 
collection  of  the  data.  All  data  were  collected  during  flights  of  Cessna 
172-N  aircraft  In  the  E-RAU  fleet. 

The  contact  and  Instrument  checkrldes  each  yielded  two  types  of  measures  for 
analysis.  First,  adequacy  of  performance  was  represented  objectively  In  terms 
of  a  percent  error  score.  That  Is,  for  each  maneuver  and  for  all  maneuvers 
scored  during  a  given  checkrlde,  the  number  of  maneuver  components  for  which 
performance  was  out  of  tolerance  was  divided  by  the  total  number  of  scored 
components  and  multi  pi  led  by  100.  Second,  (subjective)  letter  grades  assigned 
by  checkpilots  to  each  maneuver  and  to  each  of  the  four  "flight  quality"  cate¬ 
gories  were  analyzed. 

RESULTS. 

Analyses  of  variance  performed  on  contact  checkrlde  performance  revealed  no 
statistically  significant  differences  among  tracks  with  regard  to  either 
objective  or  subjective  measures.  This  finding  supported  the  hypothesis  that 
any  proficiency  differences  among  tracks  on  the  Instrument  checkrlde  would  be 
a  function  of  the  experimental  treatment  (l.e.,  training  time)  rather  than 
Initial  flight  skill  differences. 

Analysis  of  the  objective  Instrument  error  rate  scores,  the  data  of  primary 
Interest  In  this  study.  Indicated  that  differences  among  the  three  tracks  were 
not  statistically  significant.  Such  differences  as  did  occur  In  these  error 
rates  favored  the  two  lower  time  tracks  (A  and  B)  over  the  track  (C)  with  the 
greatest  amount  of  total  flight  time.  One-way  analyses  of  variance  for  the 
mean  Instrument  checkrlde  letter  grades  and  flight  quality  grades  resulted  in 
statistically  significant  differences  among  tracks  on  both  measures.  However, 


1  v 


these  differences  were  consistent  with  the  instrument  objective  error  rates  in 
that  Track  C  received  poorer  maneuver  and  flight  quality  grades  than  Tracks  A 
and  B.  These  findings  clearly  support  the  Interpretation  that  lesser  amounts 
of  prior  flight  time  had  no  adverse  effects  on  Instrument  checkrlde 
performance. 

Meaningful  analyses  of  dally  training  performance  data  could  not  be  made 
because  the  data  often  were  neither  comparable  across  students  nor  from  day  to 
day  for  a  given  student.  Summaries  of  these  data  are  presented,  nevertheless. 
Since  training  was  Individualized  to  allow  each  student  to  reach  proficiency, 
amount  of  Instrument  training  given  could  vary.  As  a  consequence,  significant 
differences  were  found  for  the  amount  of  time  given  during  Instrument  train¬ 
ing,  with  Group  A  receiving  more  Instrument  training  time  than  Groups  B  and  C. 

DISCUSSION. 

The  present  study  was  performed  to  determine  whether  level  of  pilot  exper¬ 
ience,  as  represented  by  three  different  quantities  of  total  flight  time, 
affects  the  ability  to  acquire  and  demonstrate  Instrument  flight  skills.  The 
results  of  this  experiment  suggest  that  total  flight  time,  within  the  range 
examined,  had  no  significant  effect  with  regard  to  the  level  of  instrument 
flying  skill  achieved.  It  would  thus  appear  that  prior  flight  time  should  not 
be  considered  a  primary  factor  In  defining  requirements  for  the  Instrument 
rating.  This  conclusion  Is  supported  not  only  by  the  data  reported  here,  but 
also  by  post- study  discussions  with  checkpllots  and  instructors  and  by  review 
of  the  research  literature  on  Instrument  and  contact  flight  training. 

Given  that  total  flight  hours  Is  not  relevant  as  a  requirement  for  the  Instru¬ 
ment  flight  rating.  It  Is  suggested  that  the  most  reasonable  alternative  con¬ 
sists  of  careful  definition  of  the  minimum  skills  and  knowledge  required  to 
operate  safely  under  Instrument  meteorological  conditions.  In  conjunction  with 
the  development  of  performance  standards  and  objective  measurement  procedures 
to  ensure  the  attainment  of  such  skills  and  knowledge.  Therefore,  a  systema¬ 
tic  process  consisting  of  Identification  and  development  of  three  components— 
requisite  skills,  standards  for  their  assessment,  and  performance  measurement 
methods  encompassing  these  standards—appears  necessary  If  general  aviation 
training  and  rating/certification  requirements  are  to  be  optimized. 

It  would  appear  that  the  200-hour  experience  requirement  has,  for  the  past 
forty  years,  functioned,  at  least  in  part,  as  a  de  facto  substitute  for  such 
performance  standards.  However,  the  present  results  suggest  strongly  that  the 
200-hour  experience  requirement  is  likely  Irrelevant  to  such  a  function. 

CONCLUSIONS. 

•  Within  the  ranges  of  pre- Instrument  flight  experience  examined  In  this 
study  and  for  the  subject  population  used,  amount  of  prior  flight  time 
had  no  effect  on  the  acquisition  and  demonstration  of  Instrument  flight 
proficiency. 

•  Consideration  should  be  given  to  extending  the  results  of  this  study  to 
other  populations  and  to  reducing  the  present  200-hour  experience 
requirement  for  Issuance  of  an  Instrument  rating  as  a  means  of 
encouraging  earlier  training  of  instrument  skills. 
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PREFACE 


This  report  describes  an  Investigation  of  the  effects  of  pilot  experience,  as 
defined  by  total  flight  time,  upon  the  acquisition  of  Instrument  flying  profi¬ 
ciency.  It  has  been  noted  that  low-time,  non- Instrument  rated  pilots  are 
often--perhaps  disproportionately  often--involved  in  fatal  weather- related 
accidents  because  they  Inadvertently  become  Involved  In  weather  conditions 
they  are  not  prepared  to  handle.  As  a  result,  there  has  developed  a  general 
concern  that  the  current  200-hour  experience  requirement  for  the  Instrument 
rating  (FAR  61.65)  may  postpone  unnecessarily  the  commencement  of  Instrument 
training  until  pilots  have  obtained  approximately  150  hours  of  flight  time. 
Thus,  a  question  has  arisen  as  to  the  feasibility  of  reducing  the  200-hour 
experience  requirement  with  the  objective  of  decreasing  the  Incidence  of 
weather- related  accidents  among  low-time  pilots. 

The  purpose  of  the  present  effort,  conducted  under  contract  from  the  FAA 
Technical  Center  and  Office  of  Systems  Engineering  Management,  was  to  provide 
empirical  data  for  determining  the  advisability  of  reducing  the  flight 
experience  requirement  for  the  instrument  rating.  This  study  was  jointly  con¬ 
ducted  by  the  Seville  Research  Corporation  and  Embry-Riddle  Aeronautical 
University  (E-RAU).  tSeville's  activities  were  conducted  under  subcontract  to 
th^  prime  contractor.  E-RAUT  The  prime  contract  (D0T-FA79NA-6040)  with  the 
pAAinvolves  several  tasks  concerned  with  the  Identification  of  human  factors 
problems  in  general  aviation  as  well  as  the  development  of  research  strategies 
to  reduce  or  alleviate  such  problems.  A  final  report  of  the  first  of  these 
tasks  (Task  1),  entitled  Human  Factors  Problems  in  General  Aviation,  appeared 
in  July  1980.  The  present  effort  represents  Task  2  of  this  task  order 
contract.  A  second  phase  of  the  present  effort  is  underway  to  extend  the 
results  to  other  general  aviation  population  subgroups. 

Seville  was  responsible  for  the  study  design  and  data  analyses  in  the  present 
effort.  E-RAU  was  responsible  for  the  flight  program  development,  training  of 
students,  provision  of  necessary  facilities,  equipment,  support  personnel,  and 
inflight  data  collection. 

Dr.  Jerome  I.  Berlin,  Director  of  E-RAU's  Research  Center,  Is  Program  Manager 
for  the  prime  contract.  Dr.  Wallace  W.  Prophet  served  as  Seville's  Program 
Manager  for  this  effort,  an'<T  Dr.  Jerry  M.  Childs  was  Seville's  Project 
Director.  Dr.  William  D.  Spears  of  Seville  was  responsible  for  much  of  the 
data  analysis.  Mr.  E.  Peter  Denlea  of  E-RAU's  Research  Center  coordinated  all 
research  activities  and  provided  management  assistance,  while  flight  training 
direction  and  data  quality  control  assistance  were  provided  by  Dr.  Tom 
Connolly  of  the  College  of  Aviation  Technology,  E-RAU.  The  Contracting 
Officer's  Technical  Representative  (COTR)  for  the  FAA  Technical  Center  was  Mr. 
Douglas  Harvey. 
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I.  INTRODUCTION 


General  aviation  consists  of  all  elements  of  the  nation's  aviation  activity 
except  air  carrier  and  military  operations.  With  its  some  200,000  aircraft, 
800,000  pilots,  and  extremely  diverse  tasks  and  missions,  its  scope  encom¬ 
passes  a  substantial  portion  of  the  nation's  entire  aviation  activity  (AOPA, 
1980).  Furthermore,  general  aviation's  growth  rate  for  the  next  decade  is 
expected  to  follow  the  vigorous  patterns  observed  during  the  past  five  years. 
According  to  projections  (FAA,  1979a;  AOPA,  1980),  by  1991  the  general  aviation 
fleet  will  be  almost  304,000,  a  growth  of  52%,  with  the  general  aviation  pilot 
population  reaching  approximately  1.2  million  (increase  of  50%).  Similarly, 
the  number  of  general  aviation  hours  flown  is  projected  to  increase  from  39 
million  in  1979  to  approximately  64  million  by  1991,  an  increment  of  64%. 
Overall,  most  of  the  growth  will  be  due  to  increasing  use  of  general  aviation 
aircraft  to  fulfill  business-oriented  missions. 

Accompanying  this  development  will  be  others  that  affect  general  aviation. 
For  example,  sophistication  of  avionics  will  increase;  there  will  be  a  greater 
number  of  instrument  operations  resulting  from  the  need  to  operate  under  a 
broad  range  of  weather  conditions;  adaptations  must  be  made  in  air  traffic 
control  requirements  and  procedures;  and  general  aviation  aircraft  will 
operate  Increasingly  within  areas  not  served  by  the  air  carriers.  As  a 
result,  general  aviation  development  will  carry  with  it  several  problems.  In 
addition  to  problems  such  as  fuel  and  airspace  allocation,  a  major  concern 
will  be  the  reduction  of  what  Is  considered  by  many  to  be  an  unacceptably  high 
accident  rate.  Despite  recent  Improvements  In  this  rate,  it  remains  a  prime 
concern  as  the  size  and  complexity  of  general  aviation  Increase. 

The  accident  rate  could  be  reduced  if  the  Interactive  factors  that  operate  on 
the  general  aviation  system  and  that  contribute  to  unsafe  flight  are  Identi¬ 
fied  and  appropriate  steps  are  taken  to  reduce  their  effects.  The  National 
Transportation  Safety  Board  (NTSB)  has  compiled  a  considerable  body  of  data 
related  to  causes  and  contributing  factors  In  general  aviation  accidents. 
Despite  deficiencies  in  these  data  (Shelnutt,  Childs,  Prophet,  &  Spears, 
1980),  they  provide  substantial  Insight  concerning  accident  causation  by  iden¬ 
tifying  system  factors  that  lead  to  unsafe  aircraft  operation  and  that  can  be 
corrected.  The  Interaction  of  two  such  factors  identified  In  the  NTSB  data, 
adverse  weather  conditions  and  pilot  experience  level,  was  the  focus  of  the 
study  effort  reported  here.  Pilots  sometimes  fly  In  degraded  weather  before 
they  have  acquired  the  instrument  flight  skills  needed  for  safe  aircraft 
operation  in  such  conditions.  Whether  the  pilots  do  so  by  choice,  or  are 
inadvertently  caught  in  unexpected  changes  of  weather,  they  have  been 
described  as  "accidents  waiting  to  happen." 

The  purpose  of  this  study  was  to  Investigate  the  feasibility  of  teaching  the 
needed  Instrument  skills  earlier  in  the  pilot's  flight  experience  than  is 
usually  the  case.  If  It  Is  feasible,  and  suitable  training  requirements  are 
identified  and  instituted,  there  should  be  a  resulting  reduction  In  general 
aviation  accidents  that  derive  from  the  joint  conditions  of  adverse  weather 
and  low- time  pilots'  inadequacies  to  contend  with  it. 
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Before  stating  the  specific  objectives  of  the  study,  the  context  for  the 
issues  addressed  will  be  explained. 

BACKGROUND. 

Two  NTSB  reports  for  overlapping  time  periods  clearly  reveal  the  role  of 
adverse  weather  In  aircraft  accidents.  While  for  the  eleven-year  period 
ending  In  1974,  adverse  weather  was  cited  as  a  cause  or  contributing  factor  In 
only  19%  of  all  general  aviation  aircraft  accidents,  weather  was  a  factor  In 
38%  of  those  that  resulted  In  fatalities  (NTSB,  1976).  For  the  more  recent 
period  from  1969  through  1978  (NTSB,  1980),  weather- related  accidents  resulted 
in  an  average  of  642  fatalities  per  year.  The  latter  report  also  cited 
weather  conditions  as  a  cause  or  contributing  factor  in  fatal  accidents  more 
often  than  any  other  cause  or  factor. 

Adverse  weather  obviously  poses  a  variety  of  dangers  for  flight.  When  pilots 
willingly  or  unwillingly  fly  Into  degraded  weather  conditions,  they  must  con¬ 
tend  with  the  problem  as  best  they  can.  Generally,  successful  flight  under 
such  conditions  requires  skill  In  handling  the  aircraft  while  depending  pri¬ 
marily  on  Instruments  for  cues.  Yet,  In  the  weather-rel ated  accidents 
involving  fatalities,  the  most  frequently  cited  detailed  cause/factor  was  con¬ 
tinued  VFR  into  IFR  conditions  (i.e.,  dependence  on  visual  flight  rules  tVFR] 
when  instrument  flight  rules  [IFR]  were  Indicated)  (NTSB,  1980). 

It  Is  difficult  to  pinpoint  overall  the  extent  to  which  the  pilots  Involved  In 
weather-related  accidents  simply  were  not  qualified  for  IFR  flight  because  the 
data  needed  are  not  available.  Some  supportable  Inferences  to  that  effect  are 
possible,  however.  First,  of  the  322  general  aviation  pilots  Involved  in 
fatal,  weather-related  accidents  In  1978,  some  189  or  59%  did  not  hold  Instru¬ 
ment  ratings  (NTSB,  1980).  A  second  set  of  data  (NTSB,  1974 )  covers  the 
period  1964-1972.  These  data  are  plotted  In  Figure  1  where  It  Is  apparent 
that  approximately  half  of  701  such  accidents*  Involved  pilots  with  no 
"actual"  (I.e.,  IFR  flight  conditions)  instrument  time.  (Some  had  had  experi¬ 
ence  "under  the  hood,"  however.)  An  additional  20%  had  completed  fewer  than 
20  hours  actual  Instrument  time. 

A  slightly  different  perspective  for  the  problem  Is  shown  In  Figure  2.  These 
data  are  from  the  1976  NTSB  report  covering  the  period  1964-1974.  Of  more 
than  5,200  nonfatal ,  weather-rel ated  accidents,  83%  Involved  pilots  with  fewer 
than  100  hours  of  pilot  experience.  It  Is  not  clear  how  many  of  these  acci¬ 
dents  by  almost  4,400  "low-time"  pilots  were  due  (In  addition  to  the  weather) 
to  Inadequate  IFR  skills.  However,  the  fact  remains  that  they  had  fewer  than 
100  hours  In  the  air,  and  Instrument  certification  cannot  be  obtained  until 
200  hours  have  been  accumulated  (FAR  61.65).  Furthermore,  beginning  pilots, 
who  typically  must  pay  the  entire  cost  of  their  training,  generally  do  not 
begin  instrument  training  until  they  have  acquired  enough  flight  time  (150-160 
hours)  to  obtain  the  rating  upon  completion  of  the  40-50  hours  of  Instrument 
training  typically  required.  While  acquiring  their  first  150-160  hours  of 


*Data  concerning  the  pilot's  actual  and  simulated  Instrument  flight 
experience  were  available  for  only  701,  or  35%,  of  the  total  2,026  fatal 
weather- Involved  accidents  during  that  period. 
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FIGURE  1. -NUMBER  OF  HOURS  OF  ACTUAL  INSTRUMENT  TIME  OF 
PILOTS  INVOLVED  IN  701  FATAL  WEATHER-RELATED 
ACCIDENTS  IN  1964-1972  (NTSB,  1974). 
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FIGURE  2. -NUMBER  OF  PILOTS  INVOLVED  IN  5,232  NONFATAL 
WEATHER-RELATED  ACCIOENTS  IN  1964-1974,  BY 
TOTAL  HOURS  OF  FLIGHT  EXPERIENCE  (NTSB,  1976). 
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experience,  there  is  a  high  probability  that  a  number  of  these  beginning 
pilots  will  encounter  weather  conditions  in  which  IFR  skills  will  be  needed, 
and,  as  is  readily  apparent,  often  with  disastrous  results. 

THE  200-H0UR  EXPERIENCE  REQUIREMENT. 

Except  for  Airline  Transport  Pilots,  there  was  no  civil  aviation  instrument 
rating  requirement  prior  to  about  1940.  At  that  time,  instrument  rating 
requirements  were  written  into  Part  20  of  the  old  Civil  Air  Regulations.  The 
200-hour  requirement  apparently  originated  at  that  time.  The  rationale  for 
its  designation  was  not  identified,  however.  A  comprehensive  review  of  the 
literature  concerned  with  contact  and  instrument  training  in  general  aviation 
revealed  no  evidence  that  the  requirement  was  based  on  any  empirical  data 
regarding  instrument  training  and  performance. 

The  requirement  was  probably  established  more  or  less  arbitrarily,  following 
the  pattern  of  development  of  contact  and  instrument  flying  (Jolley,  1958). 
Contact  flight  came  first  historically,  and  it  has  continued  to  be  taught 
first.  The  thinking  seems  to  have  been  that  because  contact  skills  are  easier 
to  learn  than  instrument  skills  (Ritchie  &  Michael,  1955),  the  former  should 
be  tauoht  first  and  practiced  thoroughly  prior  to  learning  instrument 
skills.  Accordingly,  minimum  instrument  rating  experience  requirements  should 
ensure  a  high  degree  of  mastery  of  contact  skills,  and  200  hours  total  flight 
time  was  considered  adequate  for  such  purpose. 

The  validity  of  this  experience  requirement  has  been  questioned  by  a  number  of 
persons,  however.  Indeed,  the  preamble  to  FAR  Part  61  states  that  in  1964,  a 
reduction  of  the  requirement  was  proposed  and  was  rejected  because  of  adverse 
public  reaction.  Among  other  considerations,  there  was  a  concern  among 
veteran  pilots  that  novice  pilots  would  resort  to  instrument  flight  in 
controlled  airspace  before  they  had  sufficiently  mastered  the  necessary  flight 
skills,  thus  endangering  others  as  well  as  themselves.  The  proposed  reduction 
in  the  200-hour  re  iui remen t  was  therefore  rejected.  Instead,  it  was  decided 
to  focus  on  improving  the  safety  of  instrument  flight  through  increased 
instruction  in  IFR  skills. 

While  increased  instrument  training  addressed  the  issue  of  safety  in 
controlled  airspace,  it  did  nothing  to  alleviate  the  problem  of  low-time 
pilots  operating  in  IFR  weather  conditions  without  the  instrument  skills 
needed  for  safe  flight.  The  180°  Turn  Program,  which  emphasizes  escape  from 
such  conditions,  more  directly  addressed  the  problem.  Further,  the  FAA's 
"Blue  Seal"  program,  which  was  implemented  in  the  mid  1970s,  was  a  step  toward 
the  acquisition  of  instrument  skills  early  in  pilot  training.  This  program 


'in  contrast,  the  available  research  literature  (see  Appendix  A)  would 
suggest,  that  this  is  the  least  effective  and  efficient  sequence  for  teaching 
such  skills.  The  sequence  of  "instruments  first,  then  contact"  and  the  so- 
called  integrated  or  composite  training  approach  are  both  more  effective  and 
efficient  than  the  typical  "contact  first,  then  instruments"  sequence. 
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emphasizes  the  importance  of  aircraft  control  by  reference  only  to  instru¬ 
ments.  All  private  pilot  candidates  are  thus  required  to  receive  some  basic 
instrument  instruction  "under  the  hood." 

Even  so,  most  would  contend  that  such  minimal  under- the- hood  instruction  does 
not  substitute  for  more  comprehensive  standard  Instrument  training  when  IFR 
competence  Is  required.  And  In  view  of  the  alarming  frequency  by  Uilch  low¬ 
time  pilots  continue  to  be  Involved  In  fatal  weather-related  accidents,  the 
question  of  the  advisability  of  the  200-hour  requirement  for  Issuance  of  the 
instrument  rating  has  again  arisen.  The  problem  Is  serious,  for  of  the 
799,000  general  aviation  pilots  In  1979,  261--205, 000— were  In  some  form  of 
training,  and  many  of  these  had  not  progressed  to  the  200-hour  level  of 
experience. 

There  have  been  several  recent  calls  for  a  reduction  In  the  200-hour  require¬ 
ment.  For  example,  two  working  groups  at  the  General  Aviation  Workshop  at 
Ohio  State  University  made  a  recommendation  to  this  effect  {Lawton  4  Livack, 
1979).  The  feasibility  of  such  a  reduction  In  the  requirement  Is  supported  by 
current  military  training  practices.  In  all  branches  of  the  military.  Instru¬ 
ment  skills  are  developed  very  early  in  pilot  training.  A  review  of  litera¬ 
ture  on  integration  of  contact  and  instrument  training,  which  appears  as 
Appendix  A  of  this  report,  lends  further  support,  at  least  In  the  sense  that 
instrument  skills  can  be  taught  quite  early  In  training,  even  prior  to  contact 
skills. 

The  recommendation  by  the  Workshop  groups  at  Ohio  State  University,  current 
military  practices,  and  inferences  from  the  literature  review  are  based  on 
rational  analyses  of  flight  skills  and  offer  Indirect  support  for  a  possible 
reduction  of  the  200-hour  experience  requirement.  What  Is  lacking  are  empiri¬ 
cal  data  to  validate  such  judgments  directly  in  terms  of  current  general 
aviation  training  practices.  Can  It  be  demonstrated,  for  example,  that  stu¬ 
dent  pilots  can  achieve  proficiency  In  Instrument  flight  skills  well  before 
they  complete  200  hours  of  total  flight  experience?  While  an  affirmative 
answer  to  this  question  does  not,  of  itself,  resolve  all  the  questions  rele¬ 
vant  to  a  possible  reduction  In  the  200-hour  experience  requirement  for  the 
instrument  rating.  It  would  clarify  an  important  aspect  of  the  problem. 

OBJECTIVES  OF  THE  STUDY. 

The  primary  objective  of  the  experiment  reported  here  was  to  determine  the 
effects  of  varying  amounts  of  prior  flight  experience  on  the  level  of  Instru¬ 
ment  flight  skills  acquired  by  students  in  a  standard  Instrument  training 
program  as  demonstrated  by  their  performance  on  the  Instrument  checkrlde. 
Both  overall  Instrument  flight  performance  and  performance  on  separate 
maneuvers  were  of  concern. 

A  secondary  objective  was  to  determine  Aether  differences  In  total  flight 
time  affected  dally  progress  In  the  learning  of  Instrument  flight  skills. 

The  results  of  this  study  will  be  one  of  several  considerations  relevant  to 
possible  revision  of  certain  FAA  policies.  It  was  Important,  therefore,  to 
obtain  data  of  the  greatest  possible  validity.  Accordingly,  the  emphasis  was 
upon  objective  measures  of  actual  pilot  performance  whose  validity  had  been 
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established.  At  the  same  time,  the  value  of  judgments  of  expert  standard¬ 
ization  pilots  was  recognized.  Procedures  for  collecting  data  were  standard¬ 
ized,  and  persons  responsible  for  recording  data  were  carefully  trained  in 
the  use  of  these  procedures.  To  ensure  applicability  of  the  findings  to 
realistic  training  and  operational  conditions,  a  well  established,  ongoing 
training  syllabus  and  Instructional  setting  were  used.  It  was  necessary,  of 
course,  to  control  carefully  the  Implementation  of  certain  aspects  of  training 
and  subsequent  checkride  evaluations  so  as  to  prevent  effects  on  data  from 
extraneous  factors.  The  control  did  not,  however,  reduce  the  practical 
realism  of  training,  as  will  be  seen  from  descriptions  of  data  collection 
methods  in  the  following  section. 

The  experimental  controls  described  allowed  the  development  of  valid  Infor¬ 
mation  within  the  general  context  of  the  effort.  However,  results  necessarily 
must  be  Interpreted  In  light  of  the  population  of  subjects  used,  the  training 
setting,  and  the  aircraft  involved.  Additional  research  is  currently  underway 
to  extend  the  results  In  terms  of  those  dimensions. 
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II.  METHOD 


EXPERIMENTAL  SETTING. 

This  study  was  carried  out  using  regularly  enrolled  students  at  Erabry-Riddle 
Aeronautical  University  (E-RAU),  Daytona  Beach,  Florida.  This  aviation- 
oriented  school  prepares  students  for  careers  In  all  aspects  of  aviation.  Its 
use  of  the  latest  aviation  and  training  technology  and  its  employment  of 
highly  qualified  professional  personnel  provided  a  setting  that  permitted  an 
adequate  level  of  experimental  control  without  sacrifice  of  training  quality. 
E-RAU  programs  in  Flight  Technology  (Private,  Commercial,  Instrument,  Multi- 
Engine,  Flight  Instructor,  and  Instrument  Flight  Instructor)  as  well  as  its 
programs  in  Maintenance  Technology  (Airframe  and  Powerplant)  are  FAA-approved . 
Student  advancement  through  the  E-RAU  curriculum  Is  Individualized  and  is 
based  upon  demonstrated  proficiency;  and  E-RAU  maintains  self-examining 
authority  under  the  direction  of  FAA's  General  Aviation  District  Office  in 
Jacksonville,  Florida. *  Under  this  authority,  students  in  the  Commercial 
Course  at  E-RAU,  from  whom  the  groups  used  in  this  study  were  selected,  typi¬ 
cally  receive  instrument  ratings  after  about  170-180  total  flight  hours.  They 
do,  however,  complete  approximately  200  hours  by  the  end  of  the  course. 

EXPERIMENTAL  DESIGN. 

The  question  addressed  in  this  study  concerned  the  efficacy  of  standard 
instrument  training  as  a  function  of  differing  amounts  of  total  flight  exper¬ 
ience.  However,  "total  flight  experience"  requires  definition  within  the 
context  of  the  training  programs  utilized  here.  All  subjects  followed  the 
same  sequence  of  training  phases  with  the  exception  that  instrument  blocks 
(Basic  Attitude  Instruments/Radio  Navigation  and  IFR  Operations)  appeared  at 
different  points  in  the  training  sequence.  Hence,  subjects  who  received 
instrument  blocks  at  later  points  also  had  completed  one  or  more  contact 
blocks  in  the  sequence  that  subjects  receiving  instrument  training  relatively 
early  had  not  yet  been  through.  Any  differences  among  groups  thus  necessarily 
would  reflect  not  only  total  flight  hours  but  training  content  (other  than 
instrument)  as  well.  However,  this  mixing  of  both  quantity  and  quality  of 
experience  is  characteristic  of  the  manner  in  which  private  pilots  typically 
increase  their  experience  levels. 

Following  this  rationale,  three  groups  of  subjects  underwent  the  same  training 
regimen  except  for  the  point  at  which  their  approximately  40  hours  of  instru¬ 
ment  training  began.  Subjects  in  one  group  (Track  A)  were  to  begin  Instrument 
training  soon  after  receiving  their  private  pilot  certificates,  i.e.,  after 
65-70  hours  of  total  flight  time;  a  second  group  (Track  B)  after  100  hours; 
and  a  third  group  (Track  C)  after  130  hours.  Although  Track  C  would  complete 


*The  criteria,  privileges,  and  limitations  associated  with  Pilot  School 
Examining  Authority  are  described  under  Subpart  D  of  FAR  Part  141  (141.63; 
141.65;  141.67).  Essentially,  the  holder  of  examining  authority  may  award 
graduates  of  the  school's  approved  certification  courses  the  associated  pilot 
certificate  or  rating  without  their  having  to  be  examined  by  FAA.  However, 
FAA  does  maintain  a  continuing  surveillance  of  such  activities  as  a  quality 
control  and  assurance  mechanism. 
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their  Instrument  training  with  somewhat  less  than  the  FAR  Instrument  rating 
requirement  of  200  hours,  this  track  was  representative  of  students  enrolled 
in  the  standard  E-RAU  Commercial  Course  with  regard  to  total  flight  hours  at 
the  instrument  checkrlde.  Thus,  Track  C  was  considered  a  control  group 
relative  to  the  two  lower- time  tracks. 


Three  sets  of  data  were  to  be  obtained  for  each  track:  (1)  measures  of  flight 
proficiency  on  a  contact  checkrlde;  (2)  dally  progress  evaluations  during 
Instrument  training;  and  (3)  measures  of  instrument  checkrlde  performance.  The 
nature  of  these  measures  and  procedures  for  obtaining  them  are  described  later. 

Comparisons  of  the  instrument  checkrlde  measures  across  tracks  were  intended 
to  reveal  the  effects.  If  any,  of  total  flight  hours  on  instrument  flight  pro¬ 
ficiency  at  the  end  of  instrument  training.  The  other  two  sets  of  measures 
were  to  aid  in  interpreting  these  comparisons. 

SUBJECTS. 


Because  this  study  involved  some  variation  from  the  standard  E-RAU  curriculum, 
subject  participation  was  voluntary.  Their  cooperation  was  sought  through 
letters  mailed  to  course  applicants  prior  to  their  enrollment,  and  through 
subsequent  interviews  with  E-RAU  Research  Center  personnel  and  orientation 
briefings.  There  were  at  least  two  Incentives  for  participating  In  the  study: 
an  opportunity  to  obtain  an  Instrument  rating  relatively  early  in  training; 
and  a  reduction  in  costs  due  to  the  possible  reduction  in  flight  hours 
corresponding  to  earlier  Instrument  certification. 


A  total  of  96  volunteers,  all  without  any  previous  flight  experience,  were 
selected  from  among  the  applicants  for  the  Commercial  Pilot  Course.  Thirty- 
two  were  assigned  to  Track  A,  34  to  Track  B,  and  30  to  Track  C.  However, 
attrition  during  training  resulted  In  27  students  remaining  In  Track  A  and  26 
In  each  of  the  other  two  tracks,  for  a  total  of  79.  For  detailed  information 
regarding  individual  students,  refer  to  Appendix  B. 


Descriptive  indices  for  the  three  groups  of  subjects  are  shown  in  Table  1. 
Statistical  significance  tests  reveal  that  distributions  of  sex,  age,  and 
attrition  were  comparable  across  all  groups  for  subjects  who  did  not  drop  out. 
Although  the  percentages  of  attrition  appear  to  differ  more  than  the  other 
measures,  they  are  well  within  sampling  (chance)  expectations.  (The  chi 
squared  for  attrition  was  only  1.28,  well  below  the  5.99  value  necessary  for 
significance  at  the  .05  level.)  However,  the  groups  did  differ  significantly 
In  terms  of  their  academic  grade  point  average  (GPA)  through  the  courses  of 
concern  here.  The  analysis  of  variance  test  yielded  an  F  of  5.55,  which  with 
2  and  76  df  is  significant  at  the  .01  level. 1 


Most  group  data  In  this  report  are  presented  In  terms  of  summary  sta¬ 
tistics  such  as  the  Mean  (M)  and  the  Standard  Deviation  (SD).  Group  differ¬ 
ences  are  evaluated  through  tests  of  statistical  significance  which.  In  turn, 
yield  probability  or  significance  level  statements  (e.g.,  £  <  .05  means  that 
there  are  fewer  than  5  chances  In  100  that  a  difference  is  due  to  chance 
alone).  In  general,  the  smaller  the  £  value,  the  more  significant  Is  the  dif¬ 
ference  being  evaluated.  For  a  more  detailed  discussion  of  the  statistical 
methodology  and  terminology  used,  the  reader  Is  referred  to  Appendix  C. 
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TABLE  1.— DESCRIPTIVE  DATA  FOR  SUBJECTS  WHO 
COMPLETED  THE  EXPERIMENT 


Track 

|  Number  of  Subjects  1 

I  Age 

r  gpa 

%  Attrition 

Male 

Female 

Total 

M 

w 

A 

24 

3 

27 

20.9 

2.1 

2.8 

0.5 

15.6 

B 

23 

3 

26 

20.2 

1.4 

2.8 

0.5 

23.5 

C 

22 

4 

26 

20.6 

1.9 

2.4 

0.5 

13.3 

The  subjects  received  their  training  (I.e.,  from  initiation  of  private  pilot 
training  through  the  instrument  training)  during  the  period  September  1979 
through  December  1980.  For  administrative  reasons.  It  was  not  possible  to 
have  all  three  tracks  in  training  at  the  same  time.  Accordingly,  Track  B 
began  training  during  the  Fall  trimester  In  1979,  Track  A  during  the  Spring 
and  Summer  trimesters  of  1980,  and  Track  C  during  the  Summer  and  Fall  tri¬ 
mesters  of  1980.  As  a  result,  assignment  of  subjects  to  tracks  could  not  be 
randomized.  Nevertheless,  the  groups  comprising  the  tracks  were  generally 
comparable,  though  some  differences,  such  as  that  for  GPA,  did  result.  How¬ 
ever,  as  will  be  noted  subsequently,  there  were  no  significant  differences  in 
flight  performance  among  the  groups  as  they  began  their  instrument  training. 

DEVELOPMENT  OF  MEASURES  AND  RELATED  PROCEDURES. 

Measuring  instruments  and  corresponding  procedures  were  developed  to  obtain 
the  sets  of  data  identified  above.  Three  criteria  were  applied  to  each  mea¬ 
sure.  First,  the  measure  must  adequately  sample  aspects  of  the  performance 
to  be  evaluated.  Second,  the  procedures  to  be  employed  must  have  been  demon¬ 
strated  to  be  valid  and  reliable.  Third,  the  data  obtained  must  permit  a 
meaningful  quantification  of  the  performance  to  be  evaluated. 

All  three  criteria  were  met  by  suitable  adaptations  of  the  widely  used  Pilot 
Performance  Description  Record  (PPDR)  developed  by  Smith,  FI  exman,  and  Houston 
(1952),  Greer,  Smith,  and  Hatfield  (1962),  and  Prophet  and  Jolley  ( 1969 ) .  The 
proper  use  of  the  PPDR  involves  a  standard  administration  sequence  for  maneu¬ 
vers  to  be  evaluated  and  a  standard  order  of  segments  comprising  each  maneu¬ 
ver.  To  the  extent  practical,  objective  measures  are  obtained  by  reference  to 
flight  status  indicators  (Instrument  readings  such  as  airspeed,  heading,  etc.) 
relative  to  criterion  values  and  permlssable  deviations.  Also,  pilot  actions 
are  reported  In  terms  of  observable  pilot  behavior.  Due  allowance  Is  made  for 
recording  judgmental  assessments  by  persons  administering  the  measure,  but 
here,  too,  procedures  and  bases  for  decisions  are  such  as  to  focus  on 
pertinent  aspects  of  performance,  and  to  ensure  reliable  measures. 

Given  a  well  validated  Instrument  such  as  the  PPDR,  the  primary  tasks  in 
adapting  It  for  the  present  study  were  ensuring  adequate  samples  of  perfor¬ 
mance  to  be  evaluated  during  contact  and  Instrument  checkrldes,  and  defining 
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desired  performance  and  tolerances.  For  this  purpose,  the  foil owing  documents 
were  reviewed: 

E-RAU  Commercial  Pilot  Certification  Syllabus 
E-RAU  Operations  Manual 

E-RAU  (Contact  and  Instrument)  Procedures  Guides 
E-RAU  Student  Workbooks  (Contact  and  Instrument  Courses) 

The  Student  Pilot's  Flight  Manual  (Kershner,  1979) 

The  Flight  Instructor's  Manual  (Kershner,  1974) 

The  Instrument  Flight  Manual  (Kershner,  1977) 

Cessna  Manual  of  Flight  (19801 
Information  Manual,  Cessna  %de1  172  N  (1978) 

Piper  Private  Pilot  Manual  1*979) 

FAA  Aviation  Weather  Guide  (FM,  1979b) 

FAA  Private  Pilot  Flight  T«?;$t  Guide  (FAA,  1975) 

FAA  Instrument  Flight  Test  Guide  (FAA,  1976) 

FAR  Parts  61,  91,  and  141 

The  Proficient  Pilot  (Schlff,  1980) 

This  material  provided  Information  concerning  the  training  of  VFR  and  IFR 
piloting  skills,  as  well  as  Information  related  to  the  tasks,  maneuvers,  and 
procedures  employed  to  assess  these  skills.  In  addition,  structured  confer¬ 
ences  with  E-RAU  checkpllots  held  early  In  the  project  provided  much  helpful 
information  concerning  acceptable  performance  parameters  for  the  candidate 
maneuvers  to  be  Included  in  the  experiment. 

Following  selection  of  a  set  of  candidate  maneuvers  to  evaluate  during  the 
contact  and  instrument  checkrldes,  each  maneuver  was  analyzed  and  discussed 
further  with  E-RAU  checkpllots  and  other  subject  matter  experts  to  determine 
fundamental  skill  components.  Feasible  patterns  were  then  determined  for 
observing  and  recording  various  aspects  of  performance,  with  segmentation 
points  within  and  between  maneuvers  defined  according  to  control  transitions 
required  to  follow  a  desired  flight  path  and  to  maintain  flight  status  indica¬ 
tors  within  tolerance  limits.  The  two  PPDRs  that  resulted  (1)  provided  mea¬ 
sures  of  a  representative  sample  of  checkrlde  performance,  (2)  were  compatible 
with  FAA  and  E-RAU  checkrlde  procedures,  (3)  were  comprehensive  for  the 
measures  involved,  and  (4)  permitted  efficient  manual  recording  of  data  during 
flight. 
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THE  CONTACT  PPOR.  Appendix  D  presents  the  Contact  PPDR  together  with  its 
associated  Handbook,  Performance  Measures,  and  Checkpllot  Training  Syllabus. 
Elqht  maneuvers  were  Involved: 

1.  Short  field  takeoff  and  departure 

2.  Approach  to  landing  stall  recovery 

3.  Slow  fl ight 

4.  180°  instrument  turn 

5.  VOR  procedures 

6.  Turns  about  a  point 

7.  Traffic  pattern 

8.  Soft  field  landing 

The  180°  instrument  turn  and  VOR  procedures  were  Included  to  assess  two 
Instrument  tasks  of  the  Private  Pilot  Blue  Seal  training  requirements  men¬ 
tioned  earlier.  The  180°  Instrument  turn  required  the  student,  while  flying 
under  the  hood,  to  maintain  a  relatively  constant  bank  angle,  airspeed,  and 
altitude  while  turning  180°.  The  VOR  problem,  which  included  only  Identifica¬ 
tion  and  Initial  track -to- station  segments,  was  also  performed  under  the  hood. 
The  eight  maneuvers  included  a  total  of  86  separate  measures  of  performance 
which  covered  a  representative  sample  of  the  skills  required  for  maneuvers 
described  In  the  FAA  Private  Pilot  Right  Test  Guide  (AC  61-54A). 

THE  INSTRUMENT  PPOR.  This  measure  was  more  comprehensive  than  the  Contact 
PPDR  because  it  was  to  be  used  to  obtain  the  primary  criterion  data  for  the 
study.  Nevertheless,  the  Instrument  PPDR  represented  a  sample  of  Instrument 
maneuvers  rather  than  the  complete  set.  Twelve  maneuvers  were  involved: 

1.  Straight  and  level  flight 

2.  Magnetic  compass  turn 

3.  Slow  fl  Ight 

4.  VOR  procedures 

5.  ADF  procedures 

6.  ILS  procedures 

7.  Holding 

8 .  Procedure  turn 

9.  Cross-country  operations 


12 


10.  Radar  vectors 

11.  Emergency  procedures 

12.  Unusual  attitude  recovery 

There  were  98  separate  performance  measures  included  in  the  twelve  maneuvers. 
This  PPDR,  along  with  its  corresponding  Handbook  and  Performance  Measures 
appears  in  Appendix  E. 

SUPPLEMENTARY  CHECKR1DE  DATA.  In  addition  to  the  PPDR  measures,  provision  was 
made  for  checkpilots  to  assign,  on  a  subjective  basis,  a  letter  grade  (A,  B, 
C,  D,  or  F)  to  the  performance  of  each  maneuver  by  each  student.  These  letter 
grades  were  recorded  at  the  bottom  of  each  PPDR  maneuver  form.  In  addition, 
letter  grades  of  A,  B,  C,  D,  or  F  were  to  be  assigned  to  each  of  four  "flight 
quality"  dimensions  describing  overall  checkride  performance.  For  the  Contact 
PPDR,  flight  qualities  were  (1)  Flight  Safety,  (2)  Smoothness,  (3)  Planning 
and  Judgment,  and  (4)  Collision  Avoidance.  For  the  Instrument  PPDR,  the 
first  three  flight  qualities  were  again  Flight  Safety,  Smoothness,  and 
Planning  and  Judgment,  but  the  fourth  was  Communications  Procedures. 

Finally,  provision  was  made  for  designating  the  presence  or  absence  of  tur¬ 
bulence  during  performance  of  a  maneuver.  The  Airman's  Information  Manual  was 
used  to  define  turbulence  levels  when  training  the  checkpilots  to  use  the 
PPDRs ,  but  during  checkrides  the  checkpilots  were  to  designate  judgmentally 
only  whether  turbulence  was  present  or  absent. 

DAILY  PROGRESS  RECORD  (OPR).  A  further  adaptation  of  the  PPDR  scoring  proce¬ 
dure  was  made  for  the  recording  of  daily  performance  during  instrument 
training.  The  maneuvers  involved  were: 

1.  Straight  and  level  flight 

2.  Airspeed  change 

3.  180°  turn 

4.  Cl imb/ descent 

5.  VOR  procedures 

6.  ADF  procedures 

7.  ILS  procedures 

8.  ILS  missed  approach 

9.  Holding 

10.  Procedure  turn 

11.  Cross-country  procedures 
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12.  Emergency  procedures:  Loss  of  radio  communications 

13.  Emergency  procedures:  Equipment/Instrument  malfunction 

14.  Unusual  attitude  recovery 

As  can  be  seen,  with  the  exception  of  additional  basic  instrument  maneuvers 
{2,  3,  and  4),  the  DPR  measures  were  essentially  the  same  as  those  Included  in 
the  Instrument  PPDR,  except  that  a  separate  score  was  recorded  for  ILS  missed 
approach  and  for  separate  subsets  of  emergency  procedures. 

In  all,  some  106  separate  measures,  at  least  four  for  each  maneuver,  were 
included  on  the  Instrument  DPR.  A  copy  of  the  DPR  appears  in  Appendix  F, 
along  with  the  corresponding  User's  Guide  and  Performance  Measures. 

CHECKPILOT  FAMILIARIZATION  TRAINING.  As  previously  noted,  E-RAU  checkpilots 
were  consulted  quite  extensively  in  the  development  of  the  PPDRs.  However,  to 
ensure  that  the  checkpilots  were  sufficiently  familiar  and  practiced  In  the 
use  of  these  inflight  recording  forms  prior  to  actual  data  collection,  they 
underwent  a  carefully  defined  and  supervised  six-day  training  program.  Prior 
to  beginning  this  training,  they  were  briefed  collectively  by  a  Seville 
investigator  and  individually  by  a  flight  training  manager  concerning  use  of 
the  forms  as  a  research  tool.  The  contents  and  schedule  for  the  checkpilot 
training  program  are  presented  in  Appendix  D. 

PROCEDURE . 

TRAINING  REGIMENS.  Figure  3  presents  the  sequences  of  training  phases  for 
Tracks  A,  0,  and  C.  The  three  tracks  depart*  only  slightly  from  the  standard 
E-RAU  curriculum,  which  also  appears  in  the  right  hand  portion  of  Figure  3. 
Except  for  the  time  for  initiating  instrument  training  and  the  deletion  of  the 
normally  scheduled  back  seat  observer  time,  the  only  discrepancy  is  the 
reverse  order  of  Commercial  Maneuvers  and  Advanced  Solo  Cross-Country  for  all 
three  tracks  as  compared  to  the  standard  curriculum. 

The  portions  of  the  training  of  specific  concern  in  this  study  are  those 
leading  up  to  and  included  in  instrument  instruction.  As  shown  in  Figure  3, 
all  three  groups  first  went  through  a  common  sequence,  beginning  with  a 
Presolo  block  and  progressing  through  Basic  Flying,  Presolo  Cross-Country 
(X-C),  Private  Pilot,  and  Night  Operations.  (See  Appendix  G  for  further 
information  concerning  these  and  other  blocks.)  At  this  point.  Track  A  began 
BAI/Radio  Navigation,  followed  by  IFR  Operations,  while  Tracks  B  and  C  under¬ 
went  Advanced  Solo  X-C.  Track  B  then  took  the  BAI/Radio-IFR  blocks  while 
Track  C  followed  Advanced  Solo  X-C  with  Commercial  Maneuvers.  Finally,  Track 
C  followed  Commercial  Maneuvers  with  the  BAI/Radio-IFR  blocks.  Training 
following  IFR  Operations  was  not  of  concern  in  this  study.  However,  it  was 
the  same  across  groups  except  as  the  sequence  was  interrupted  by  introduction 


^Training  hours  waiver  and  self-examining  authority  for  each  experimental 
group  were  approved  by  the  FAA  General  Aviation  District  Office  in 
Jacksonville,  Florida. 
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of  Instrument  training  at  the  different  points  just  Identified.  For  ease  of 
Identification,  the  Instrument  training  (BAI/Radio  Navigation  and  IFR 
Operations)  Is  enclosed  In  a  box  In  Figure  3. 

A  total  of  13  Instructors  served  the  three  tracks.  Information  regarding 
individual  instructors  appears  in  Appendix  H.  Their  mean  age  was  22.9  years, 
and  their  mean  prior  flight  experience  was  1,329  hours.  The  mean  number  of 
hours  they  had  provided  Inflight  Instrument  Instruction  was  approximately  122, 
and  of  dual  flight  Instruction  with  students,  327.  in  addition  to  their 
responsibilities  as  instructors,  those  Involved  in  Instrument  training 
recorded  measures  on  the  DPR  dally  for  each  student. 

It  was  not  possible  to  control,  i.e.,  balance,  assignments  of  Instructors 
across  tracks.  In  fact,  there  was  a  35%  turnover  of  Instructors  during  the 
16-month  course  of  the  experiment.  All  conformed  to  usual  E-RAU  training 
practices,  however,  and  each  track  had  at  least  5  different  Instructors, 
thereby  tending  to  minimize  unique  effects  of  any  single  Instructor  on  the 
outcome  of  the  study. 

Similarly,  the  specific  instruction  and  sequence  of  activities  provided  each 
student  subject  were  not  controlled  In  a  rigid  sense.  That  Is,  while  each 
subject  followed  the  structure  of  the  syllabus  for  his  or  her  track,  training 
practices  were  adapted  as  needed  for  each  student  according  to  the  judgment  of 
the  Instructors. 

There  was  a  control,  however,  over  the  number  of  hours  of  flight  time  accumu¬ 
lated  at  the  time  of  entry  4«to  Instrument  training.  For  Track  A,  every  stu¬ 
dent  had  67  hours,  for  Track  B,  100  hours,  and  for  Track  C,  130  hours. 
Instrument  training  then  progressed  on  an  Individualized  basis  as  dictated  by 
each  student's  needs.  Mean  exit  hours  (and  standard  deviations)  for  Instru¬ 
ment  training  were  113.6  (7.2)  for  Track  A,  138.5  (6.1)  for  Track  B,  and  171.2 
(7.2)  for  Track  C.  These  date  are  shown  In  Table  2. 


TABLE  2.— INSTRUMENT  TRAINING  ENTRY,  IN-TRAINING, 
AND  EXIT  TIMES  BY  GROUP 


Total  Hours  at  Entry 

Instrument  Training  Hours 

Total  Hours  at  Exit 

Track 

—  w  W 

F  W  “ 

A 

67.0  0 

46.6  7.2 

113.6  7.2 

B 

100.0  0 

38.5  6.1 

138.5  6.1 

C 

130.0  0 

41.2  7.2 

171.2  7.2 

Note;  Since  all  students  In  a  given  group  had  the  same  number  of  total  hours 
at  entry  into  the  Instrument  training  block,  there  was  no  variability  (SO)  of 
entry  times  within  the  group.  The  variability  of  exit  hours  within  a  group  Is 
necessarily  Identical  with  the  variability  of  Instrument  training  hours  for 
that  group  because  of  the  common  entry  hour  level  within  each  group. 
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PERFORMANCE  DATA.  The  three  sets  of  flight  performance  data  Identified 
earlier  were  collected  for  the  three  tracks  at  points  determined  by  the  Ini¬ 
tiation  and  conclusion  of  Instrument  training  rather  than  by  completion  of 
other  training  blocks.  Thus,  contact  checkrlde  measures,  obtained  just  before 
beginning  Instrument  training,  followed  Night  Operations  for  Track  A,  Advanced 
Solo  X-C  for  Track  B,  and  Commercial  Maneuvers  for  Track  C.  Accordingly, 
Track  A  had  the  lowest  number  of  flight  hours  prior  to  the  contact  checkrlde 
and  C  the  highest.  (However,  as  evident  below,  these  checkrlde  measures  con¬ 
cerned  aspects  of  performance  for  which  fairly  high  degrees  of  mastery  could 
be  expected  prior  to  the  additional  training  Tracks  B  and  C  received  before 
their  checkrldes.  In  fact.  Track  C  had  the  highest  error  rate  on  the  contact 
checkrlde,  though  as  shown  In  the  Results  section  of  this  report,  their  dif¬ 
ferences  from  Tracks  A  and  B  were  not  statistically  significant.) 

The  second  set  of  data  comprised  the  daily  performance  records  (DPRs)  which 
were  designed  to  reveal  progress  during  the  Instrument  training  phase.  While 
these  measures  were  adequate  to  reveal  progress  of  all  tracks,  the  data  were 
not  sufficiently  standardized  for  statistical  comparisons  of  tracks.  For 
example,  differences  In  opportunities,  students'  needs  and  instructors'  pre¬ 
ferences  regarding  practice  tasks,  and  Individual  students'  progress,  resulted 
in  variations  in  types  of  performance  rated  from  day  to  day,  especially  during 
the  later  stages  of  Instrument  training.  These  data  are  presented  In  Appendix 
I;  however,  in  Interpreting  them,  the  reader  should  bear  these  variations  in 
mind,  especially  the  likelihood  that  the  ratings  In  later  stages  of  training 
emphasized  skills  that  needed  further  practice  rather  than  those  already 
mastered.  In  other  words,  later  overall  progress  is  probably  underrepresented 
In  the  data. 

The  third  set  of  data,  PPOR  measures  of  Instrument  checkrlde  performance,  was 
obtained  during  the  students'  Instrument  checkrldes  which  occurred  upon 
completion  of  instrument  training.  These  data  are  the  primary  focus  of  the 
analyses  reported  later  because  they  are  the  critical  Indicators  of  the  suc¬ 
cess  of  instrument  training. 

All  data  were  collected  during  flights  of  aircraft  In  the  E-RAU  fleet  of  48 
Cessna  172  N  planes.  All  aircraft  were  1977-1980  models  and  were  fully 
equipped  for  Instrument  flight.  Procedures  followed  by  checkpllots 
recording  data  are  described  for  each  measuring  Instrument  In  Appendices  D,  E, 
and  F.  It  should  be  pointed  out,  however,  that  checkpllots  were  asked  to 
record  performance  Immediately  when  it  was  not  within  acceptable  limits 
(safety  permitting).  On  the  other  hand,  instances  of  acceptable  performance 
could  be  recorded  at  the  end  of  each  maneuver.  Thus,  remembering  vrfilch 
aspects  of  performance  were  or  were  not  within  tolerance  did  not  pose  a 
problem  for  data  reliability. 

Eight  checkpllots  were  Involved  in  the  collection  of  the  PPDR  data,  five  of 
whom  accounted  for  approximately  80%  of  all  the  checkrlde  data  collected. 
While  the  number  of  checkrldes  administered  by  each  checkpllot  could  not  be 
controlled  across  tracks,  several  different  checkpllots  administered  check¬ 
rldes  within  each  training  track. 

Descriptive  data  concerning  the  checkpllots  appear  In  Appendix  H.  Their  mean 
age  was  42  years,  and  their  mean  flight  experience  was  5,227  hours. 
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III.  RESULTS 


The  Contact  PPDR  and  Instrument  PPDR  each  yielded  two  types  of  measures  for 
analysis.  First,  adequacy  of  performance  as  measured  on  either  PPDR  was 
represented  In  terms  of  percent  error.  That  Is,  for  each  maneuver  and  for  all 
maneuvers  scored  during  a  given  checkride,  the  number  of  maneuver  components 
for  which  performance  was  out  of  tolerance  was  divided  by  the  total  number  of 
scored  components  and  mul tipi  led  by  100,  thereby  yielding  a  "percent  error 
score."  The  second  type  of  measure  was  the  letter  grade  assigned  by  check- 
pllots  to  each  maneuver  and  to  each  of  the  four  "flight  quality"  categories. 
There  was  a  substantial  relationship  between  overall  objective  measures  of 
maneuver  performance  and  overall  grades  for  the  maneuvers  (see  Appendix  J  for 
these  data).  However,  the  relationship  was  not  so  high  as  to  preclude  the 
possibility  that  the  two  types  of  measures  provided  different  kinds  of  eval¬ 
uative  Information  to  some  extent.  Therefore,  both  types  of  measures  were 
analyzed,  as  well  as  the  grades  on  flight  qualities. 

While  the  primary  concern  was  Instrument  checkrlde  performance,  data  from  the 
Contact  PPDR  will  be  considered  first  with  regard  to  the  comparability  of  the 
student  groups  comprising  Tracks  A,  B,  and  C.  It  will  be  recalled  that 
assignments  to  these  groups  were  constrained  by  certain  administrative 
considerations,  so  strict  randomization  of  assignments  was  not  feasible. 

CONTACT  PPDR. 

Means  (M)  and  standard  deviations  (SD)  for  total  percent  error  and  for  average 
maneuver  grades  across  all  contact  maneuvers  are  shown  in  Table  3  for  the 
three  tracks.  Graphical  depictions  of  these  data  are  included  In  Appendix  J. 
The  percent  error  means  were  compared  using  a  one-way  analysis  of  variance 
(ANOVA).  The  calculated  £  was  1.05,  which  for  2  and  76  degrees  of  freedom 
( df)  did  not  approach  significance.  Similarly,  "he  standard  deviations  did 
not  differ  significantly  when  their  squares  were  tested  by  the  Fmax  procedure 
of  Hartley  (Winer,  1971,  p.  206).  The  obtained  Fmax  was  1.71,  while  a  value 
greater  than  2.50  would  have  been  necessary  for  significance  at  the  .05  level. 


TABLE  3.— MEANS  (M)  AND  STANDARD  DEVIATIONS  (SD) 
OF  SCORES  ON  CONTACT  CHECKRIDE 


Track 

N 

- PPDR  TotaTT  Error”' 

Average  Maneuver  Grade 

M 

W 

M 

SD 

A 

27 

20.08 

10.11 

2.31 

.63 

B 

26 

20.35 

13.23 

2.24 

.55 

C 

26 

24.36 

12.73 

2.16 

.61 
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A  similar  analysis  was  made  of  mean  subjective  grades  assigned  by  checkpllots 
to  each  of  the  various  maneuvers.  Letter  grades  were  scaled  by  assigning  a 
value  of  4  for  A,  3  for  B,  2  for  C,  1  for  D,  and  0  for  F.  Means  for  Indivi¬ 
dual  students  were  obtained  by  summing  the  numerical  equivalents  of  their 
grades  across  the  eight  maneuvers  and  dividing  by  8.  Again,  significance  was 
not  even  approached,  for  the  calculated  £  for  mean  differences  was  .39,  and 
the  Fmax  for  squares  of  standard  deviations  was  1.29. 

In  passing,  It  Is  Interesting  to  note  the  variations  In  difficulty  among  the 
separate  maneuvers  scored  on  the  Contact  PPDR.  Figure  4,  which  depicts  mean 
percent  error  on  the  Contact  PPDR,  shows  that  considerable  variations 
occurred.  The  pattern  Is  quite  consistent  across  tracks,  however. 

"Flight  quality"  grades  were  analyzed  differently  because  the  separate  quali¬ 
ties  were  not  sufficiently  homogeneous  in  nature  to  permit  a  meaningful  over¬ 
all  average.  The  analysis  was  an  ANOVA  for  multiple  observations  on  the  same 
subjects.  Groups  to  be  compared  were  again  the  three  tracks,  and  the  multiple 
observations  were  numerical  equivalents  of  grades  on  each  of  the  four  quali¬ 
ties.  Only  one  £  exceeded  unity,  1.49  for  differences  among  overall  track 
means,  and  this  value  Is  far  less  than  the  tabled  value  (3.12)  required  for 
significance  at  the  .05  level.  A  critical  test  of  track  comparability  was 
provided  by  the  track  by  quality  interaction.  The  calculated  £  (0.33)  indi¬ 
cated  that  the  tracks  were  highly  similar  with  regard  to  flight  quality. 

Failure  to  find  significant  differences  among  tracks  does  not  establish  that 
they  were  completely  equivalent  prior  to  Instrument  training.  However,  the 
low  £s  obtained,  and  with  sizeable  dfs,  mean  that  any  differences  that  might 
have  existed  In  the  flight  skills  measured  on  the  Contact  PPDR  were  neces¬ 
sarily  too  small  to  affect  Interpretation  of  the  data  from  the  Instrument 
PPDR.  This  conclusion  *s  supported  further  by  the  data  presented  earlier  in 
Table  i  regarding  the  distributions  of  sex,  age,  GPA,  and  attrition  rates  for 
the  three  tracks,  though  it  will  be  recalled  that  prior  GPA  did  differ  signi¬ 
ficantly. 

INSTRUMENT  PPDR. 

Table  4  presents  the  means  and  standard  deviations  of  PPDR  total  percent 
error  and  of  maneuver  grades  for  the  three  tracks  on  the  Instrument  PPDR. 
Graphical  depictions  of  these  data  are  Included  in  Appendix  J.  A  comparison 
of  the  percent  error  means  using  a  one-way  ANOVA  yielded  an  F  of  2.54  which  Is 
appreciably  below  the  value  of  3.12  required  for  statistical  significance  at 
the  .05  level.  The  differences  among  standard  deviations  approached,  but  did 
not  reach,  the  .05  level  of  significance,  however,  with  an  £max  also  of  2.54. 

For  the  purposes  of  this  study,  the  £  for  means  has  a  straightforward  implica¬ 
tion.  While  It  is  Impossible  to  establish  that  the  means  differ  only  because 
of  chance,  the  fact  that  statistical  significance  was  not  obtained  Indicates 
that  If  true  differences  existed,  they  were  small.  Further,  the  group  with 
the  greatest  amount  of  flight  experience  prior  to  Instrument  training  (and  at 
the  time  of  the  Instrument  checkrlde).  Track  C,  had  the  highest  mean  error. 
Hence,  mean  Instrument  checkrlde  performance  as  measured  by  the  objective  por¬ 
tion  of  the  PPDR  was  definitely  not  affected  adversely  by  receiving  Instrument 
training  early  In  the  curriculum.  However,  it  should  be  noted  that  each 
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FIGURE  4.— MEAN  PERCENT  ERROR  BY  CONTACT  PPDR  MANEUVER. 


student  In  each  group  who  completed  the  Instrument  training  passed  the  instru¬ 
ment  checkride  in  accord  with  FAA  standards  in  the  same  manner  as  regular 
E-RAU  students. 


TABLE  4.— MEANS  (M)  AND  STANDARD  DEVIATIONS  (SD) 
OF  SCORES  OK  INSTRUMENT  CHECKRIDE 


Track 

N 

PTOlTTotal  '%  Crror-'  1 

1  Average  Maneuver  Grade 

M 

$![ 

M 

A 

27 

17.88 

13.32 

2.10 

.67 

B 

26 

17.66 

11.25 

2.29 

.71 

C 

26 

23.78 

8.35 

1.83 

.55 

A  one-way  ANOVA  for  the  mean  letter  grades,  scaled  as  described  previously  for 
each  group,  resulted  In  a  statistically  significant  difference.  The  F  was 
3.37,  which  is  slightly  higher  than  3.12,  the  value  for  the  .05  level  with  2 
and  76  df.  The  Fmax  of  1.66  for  standard  deviations  did  not  approach  signifi¬ 
cance,  Tiowever.  As  with  contact  checkride  performance.  Track  C,  which  had  the 
greatest  amount  of  flight  time  prior  to  instrument  training,  had  the  highest 
error  rate.  Thus,  the  reduction  in  previous  flight  time  for  Tracks  A  and  B 
had  no  adverse  effect  on  their  performance  as  represented  by  mean  maneuver 
grades. 

Mean  PPDR  nerformances  by  the  separate  tracks  on  each  of  the  12  instrument 
maneuvers  are  shown  in  Figure  5.  The  patterns  from  maneuver  to  maneuver  are 
quite  similar,  but  it  can  be  seen  that  the  higher  overall  error  rate  for  Track 
C  was  due  mainly  to  relatively  poorer  performance  on  the  first  three  maneuvers 
(Straight  and  Level,  Magnetic  Compass  Turn,  and  Slow  Flight)  of  the  Instrument 
PPDR  and,  to  a  lesser  extent,  on  the  last  two  maneuvers  (Emergency  Procedures 
and  Unusual  Attitude  Recovery). 

As  with  the  contact  checkride,  grades  on  the  four  flight  quality  categories 
were  analyzed  by  an  ANOVA  for  multiple  observations  on  the  same  subjects. 
These  categories  differ  from  those  for  the  contact  checkride  only  in  that 
Communication  Procedures  replaced  Collision  Avoidance.  A  summary  of  the  anal¬ 
ysis  appears  in  Table  5.  The  Fs  of  particular  Interest  are  those  for  Track 
and  for  the  Track  by  Quality  interaction  because  they  can  reveal  track  dif¬ 
ferences.  Both  were  significant  at  the  .05  level.  An  F  of  3.12  was  required 
for  the  track  significance,  and  2.14  for  the  interaction.  The  obtained  Fs 
were  3.86  and  2.56,  respectively.  The  separate  means  are  plotted  In  Figure  F. 
It  Is  apparent  that  the  significant  F  for  track  differences  Is  due  primarily 
to  the  mean  grades  of  Track  C  being  consistently  below  (i.e.,  poorer  than)  the 
means  for  Tracks  A  and  B.  Also,  the  Interaction  Is  due  primarily  to  the  rela¬ 
tive  superiority  of  Track  B  on  Flight  Safety,  and  the  greater  inferiority  of 
Track  C  on  Communication  Procedures.  As  with  the  objective  data  from  the 
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FIGURE  5.— MEAN  PERCENT  ERROR  BY  INSTRUMENT  PPDR  MANEUVER. 
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FLIGHT  SMOOTHNESS  PLANNING  COMMUNICATIONS 

SAFETY  AND  JUDGMENT  PROCEDURES 

FLIGHT  QUALITY 


FIGURE  6.— MEAN  FLIGHT  QUALITY  SCORES  FOR  INSTRUMENT  CHECKRIDE. 


Instrument  PPDR,  the  grades  assigned  by  checkpllots  also  clearly  support  the 
Interpretation  that  lesser  amounts  of  prior  flight  time  had  no  adverse  effect 
on  Instrument  checkrlde  performance. 


TABLE  5.— SUMMARY  OF  THE  ANOVA  FOR  GRADES  ON 
INSTRUMENT  CHECKRIDE  FLIGHT  QUALITIES 


Source 

df 

Mean 

Square 

F 

£ 

Between  subjects 

Track  (T) 

2 

10.83 

3.86 

<.05 

Between  error 

75 

2.809 

Within  subjects 

Quality  (Q) 

3 

7.880 

11.35 

<.001 

T  x  Q 

6 

1.775 

2.56 

<.05 

Within  error 

225 

0.6943 

Note:  Data  for  one  student  who  was  nearest  the  average  for  all  measures  were 
eliminated  from  Track  A  so  as  to  equate  numbers  of  subjects  across  groups. 

DAILY  PROGRESS  RECORD. 

As  pointed  out  In  Section  II,  meaningful  analyses  of  DPR  data  could  not  be 
made  because  the  data  often  were  neither  comparable  across  students  nor  from 
day  to  day  for  a  given  student.  Summaries  of  these  data  are  presented  In 
Appendix  I,  nevertheless.  In  viewing  them.  It  should  be  recalled  that  tasks 
practiced  on  the  later  days  more  likely  emphasized  skills  needing  Improvement, 
thus  slighting  skills  that  had  been  learned  well.  As  a  result,  errors  shown 
for  later  practice  periods  are  probably  disproportionately  high.  Also,  these 
curves  do  not  show  the  rapid  Initial  drop  In  errors  characteristic  of  most 
learning  curves  of  this  nature.  The  reason  Is  likely  that  these  students  had 
already  gained  considerable  mastery  of  basic  flight  skills  at  the  time  they 
entered  Instrument  training.  Therefore,  the  period  of  rapid  error  reduction 
characteristic  of  classical  learning  curves  had  ended  before  these  DPR  data 
were  collected. 

Although  factors  related  to  the  recording  of  DPR  data  prevent  a  direct  Inspec¬ 
tion  of  bases  for  differences  In  early  stages  of  learning,  the  early  differ¬ 
ences  may  relate  to  prior  flight  experience.  Even  so,  the  maneuver  curves 
that  extend  to  10  or  more  trials,  when  plotted  for  all  three  tracks  on  one 
graph,  usually  converge  toward  the  end  of  Instrument  training.  In  other 
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words,  any  differences  among  tracks  in  early  training  decreased  over  time  with 
the  result  that  differences  essentially  disappeared  by  the  end  of  training. 
This  is  as  would  be  expected  in  an  individualized  training  program  in  which 
training  Is  varied  as  befits  the  individual  student's  needs  In  achieving  the 
specified  terminal  training  objectives  or  performance  levels  that  define  the 
goals  of  training. 

TRAINING  TIME. 

Another  aspect  of  the  instrument  training  should  be  noted.  While  the  results 
described  have  shown  no  significant  differences  in  the  flight  performance  of 
the  three  groups  at  the  end  of  their  instrument  training,  the  DPR  data  just 
mentioned  suggest  the  possibility  of  some  differences  during  the  acquisition 
of  instrument  skills  by  the  three  tracks.  Another  index  of  such  "process" 
differences1  is  the  amount  of  time  taken  by  the  students  to  complete  the 
requirements  of  their  instrument  training. 

As  can  be  derived  from  the  instrument  training  entry  and  exit  times  previously 
given  for  the  three  training  tracks.  Track  A  received  a  mean  of  46.6  instru¬ 
ment  training  hours.  Track  B  38.5  hours,  and  Track  C  41.2  hours.  Analysis  of 
variance  for  these  times  yielded  an  £  of  9.76  which,  for  2  and  76  df,  is 
significant  at  the  .001  level.  Thus,  the  least  experienced  group  (Track  A1 
received  somewhat  more  instrument  instruction  to  meet  the  course  requirements 
than  did  the  other  two  tracks.  It  is  noted,  though,  that  the  least  amount  of 
instrument  instruction  was  received  by  the  Intermediate  experience  level  group 
(B),  Nevertheless,  in  spite  of  these  process  differences,  the  outcome  of  such 
tracing  was  a  level  of  Instrument  flight  performance  that  was  not  signifi¬ 
cantly  different  among  the  three  track  groups;  all  subjects  in  all  three 
groups  met  the  same  standards  of  performance  as  do  students  in  the  regular 
Commercial  Pilot  Course,  i.e.r  passing  the  instrument  checkride  in  accord  with 
FAA  standards. 

It  is  obvious,  of  course,  that  there  are  many  process  differences  from  one 
training  program  to  another  in  general  aviation  as  to  how  the  required  skills 
are  produced.  However,  the  requirement  that  all  students  meet  the  common  per¬ 
formance  criteria  as  defined  by  FAA  flight  test  requirements  is  Intended  as 
the  quality  assurance  mechanism  for  differing  flight  programs.  Thus,  the 
emphasis  by  FAA  on  outcome  measures  of  performance,  i.e.,  checkride  perfor¬ 
mance,  and  standardized  criteria  seems  fitting.  Such  emphasis  also  charac¬ 
terizes  the  present  study. 


In  the  evaluation  of  education  and  training  programs,  the  terms  "process 
measure"  and  "product"  or  "outcome  measure"  have  come  Into  widespread  use.  In 
the  present  context.  Indices  resulting  from  the  instrument  check  are  the 
"product"  measures,  while  those  relating  to  the  Instrument  training  program 
Itself— e.g.,  the  DPR  data  and  Instrument  training  times— are  the  "process" 
measures. 
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IV.  DISCUSSION  AND  CONCLUSIONS 


The  present  study  was  performed  to  determine  whether  level  of  pilot  exper¬ 
ience,  as  represented  by  three  different  amounts  of  total  flight  time, 
affects  the  ability  to  acquire  and  demonstrate  Instrument  flight  skills.  The 
finding  was  that  total  flight  time,  within  the  range  examined,  had  no  effect 
Insofar  as  outcome  measures  obtained  during  the  Instrument  checkrlde  are  con¬ 
cerned.  In  fact,  observed  Instrument  performance  differences  slightly  favored 
students  with  the  lesser  amounts  of  experience  (113  or  138  hours)  over  those 
with  the  greatest  amount  of  flight  experience  (171  hours).  The  maneuvers 
Included  In  the  Instrument  PPDR,  and  the  98  specific  measures  of  performance 
on  them,  encompassed  not  only  the  critical  Indicators  of  Instrument  flight 
skills,  but  also  the  aspects  of  aircraft  control  required  for  safe  operation 
In  controlled  airspace. 

It  would  appear,  on  the  basis  of  these  data,  that  factors  other  than  prior 
flight  time  should  be  considered  In  defining  criteria  for  the  Instrument 
rating.  This  conclusion  Is  supported  not  only  by  the  data  reported  here,  but 
by  post-study  discussions  with  checkpllots  and  Instructors  and  by  review  of 
the  research  literature  on  Instrument  and  contact  flight  training  (Appendix 
A). 


The  200-hour  requirement  has  been  assumed  to  promote  operational  safety. 
Prior  to  this  study,  however,  justification  for  the  requirement  has  not  been 
examined  empirically.  While  It  Is  true  that  proficiency  generally  tends  to 
1  Improve  with  experience.  It  must  be  remembered  that  errors  In  judgment  or 

'  decision  making  continue  to  occur  among  pilots  with  thousands  of  hours  of 

total  flight  time.  But,  It  must  also  be  remembered  that  errors  In  judgment  or 
decision  making,  along  with  Inadvertent  circumstantial  occurrences,  result  In 
significant  numbers  of  low  experience  pilots  being  placed  In  Instrument  flight 
situations  with  which  they  are  111  equipped  by  their  training  to  cope,  often 
with  fatal  results.  Thus,  given  that  total  flight  hours  Is  not  an  adequate 
guide  for  defining  the  point  at  which  the  rating  of  Instrument  capability 
should  be  awarded,  the  Important  operational  question  concerns  possible  alter¬ 
natives  to  the  rigid  200-hour  requirement. 

Perhaps  the  most  reasonable  alternative  would  consist  of  more  careful  defini¬ 
tions  of  the  minimum  skills  and  knowledge  required  to  operate  safely  under 
Instrument  meteorological  conditions,  In  conjunction  with  the  development  of 
performance  standards  and  objective  measurement  procedures  to  determine  that 
the  skills  and  knowledge  have  been  attained.  Therefore,  a  systematic  effort 
to  Identify  requisite  skills  and  standards  for  their  assessment,  and  to 
develop  performance  measurement  methods  encompassing  these  standards,  appears 
necessary  If  general  aviation  training  and  rating/certification  requirements 
are  to  be  optimized. 

The  development  and  Implementation  of  explicit  flight  proficiency  standards 
would  ensure  that  applicants  for  all  certificates  and  ratings  (not  just  the 
Instrument  rating)  would  be  sufficiently  skilled  to  operate  safely  in  the 
National  Airspace  System.  It  Is  evident  from  the  safety  data  discussed  In 
the  first  section  of  this  report  that  the  numbers  of  fatal,  weather- related 
accidents  among  low-time  pilots  are  excessive.  A  more  direct  approach  to  the 
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skills  required  to  handle  Instrument  flight  situations  among  such  pilots  would 
seem  In  order.  Experience  Is  Important,  but  the  present  results  suggest  It  Is 
the  content  of  such  experience  and  not  Its  amount  that  Is  of  primary  concern. 

The  paramount  question,  then,  seems  to  be  whether  adequate  performance  stan¬ 
dards  can  be  generated,  adopted  nationally,  and  employed  consistently  by  all 
flight  proficiency  evaluation  personnel  as  a  replacement  for  the  200-hour 
experience  requirement.  The  200-hour  requirement  has  for  the  past  forty  years 
functioned  as  a  de  facto  substitute  for  such  standards,  but,  as  noted,  the 
accident  data  raise  serious  questions  as  to  Its  effectiveness.  More  specific 
and  pertinent  criteria  for  evaluating  the  complex  skills  required  for  safe 
aircraft  operation  In  Instrument  meteorological  conditions  seem  required. 

CONCLUSIONS. 

1.  Within  the  ranges  of  pre- Instrument  flight  experience  examined  In  this 
study  and  for  the  subject  population  used,  amount  of  prior  flight  time  had 
no  effect  on  the  acquisition  and  demonstration  of  Instrument  flight  profi¬ 
ciency. 

2.  Consideration  should  be  given  to  extending  the  results  of  this  study  to 
other  populations  and  to  reducing  the  present  200-hour  experience  require¬ 
ment  for  issuance  of  an  Instrument  rating  as  a  means  of  encouraging 
earlier  training  of  instrument  skills. 
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APPENDIX  A 


PAST  RESEARCH  ON  INTEGRATED  TRAINING 


INTEGRATED  TRAINING. 

There  is  a  sizeable  body  of  literature  on  the  acquisition  and  retention  of 
contact  and  instrument  flight  skills.  A  review  of  this  literature  revealed 
twelve  previous  empirical  studies  bearing  on  the  feasibility  of  early  instru¬ 
ment  training.  These  studies  were  all  concerned  directly  or  indirectly  with 
the  introduction  of  instrument  flying  early  in  the  training  process.  Some 
form  of  such  training,  termed  integrated  training  when  combined  with  contact 
training,  would  appear  to  offer  the  greatest  potential  for  eliminating  the 
current  operational  problem  described  in  the  body  of  this  report.  These 
studies  were  considered  relevant  to  the  present  effort  because  of  their  treat¬ 
ment  of  content,  format,  and  sequence  of  contact  and  instrument  training  and 
their  impl ications  concerning  effects  of  such  training  upon  pilot  proficiency. 
Following  are  brief  synopses  of  several  of  the  studies  that  are  especially 
relevant  to  present  purposes. 

CIVIL  AVIATION  RESEARCH  ON  INTEGRATED  TRAINING.  The  first  reported  attempt  to 
integrate  contact  and  instrument  training  was  made  by  Lee  (1935)  at  the  Boeing 
School  of  Aeronautics.  He  trained  16  students  solely  by  reference  to  instru¬ 
ments  during  their  first  23  hours  of  training.  This  was  followed  by  contact 
training  and  later  by  a  combination  of  the  two.  Results,  although  subjec¬ 
tively  evaluated,  were  positive  and  prompted  Lee  to  conclude  that  students 
enrolled  in  long-term  flight  training  courses  should  begin  instruction  under 
the  hood.  However,  the  study  employed  no  control  groups,  used  highly 
impressionistic  assessments  of  student  performance,  and  failed  to  integrate 
contact  and  instrument  skills  at  the  start  of  training. 

Two  decades  elapsed  before  further  work  In  this  area  was  reported,  at  which 
time  Ritchie  and  Michael  (1955)  examined  the  transfer  effects  of  instrument- 
to-contact  training,  and  o*  contact- to-instrument  training.  Groups  of  stu¬ 
dents  with  no  flight  experience  were  trained  either  on  instruments  followed  by 
contact  or  on  contact  followed  by  instruments.  There  were  11  students  in  each 
group.  Relatively  objective  measures  of  performance  were  obtained  on  two 
maneuvers--stra1ght  and  level  flight  and  180°  turns.  Upon  attainment  of  cri¬ 
terion  performance  on  both  maneuvers  by  one  method,  students  commenced 
training  on  these  same  maneuvers  by  the  other  method.  More  trials  were 
required  to  learn  instruments  than  contact.  Of  greater  significance,  however, 
was  the  finding  that  contact  and  Instrument  flying  had  very  different  transfer 
effects  upon  each  other.  Specifically,  contact- trained  subjects  demonstrated 
a  negative  22%  transfer  effect  on  learning  instruments,  while  Instrument- 
trained  subjects  showed  a  positive  W%  transfer  effect  on  learning  contact. 
Ritchie  and  Michael  concluded  that  the  difference  in  the  direction  of  transfer 
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might  be  expected  to  reduce  the  overall  learning  time  for  both  forms  of 
training  when  instrument  skills  are  trained  before  contact.  They  further 
indicated  that  the  traditional  approach  to  flight  training  has  been  at  least 
wasteful  of  training  efforts,  and  may  have  led  "a  whole  generation"  of  pilots 
to  hate  instruments  because  instrument  flight  introduces  actions  that  compete 
with  strongly-established  contact  habits. 

A  later  study  by  Ritchie  and  Hanes  (1964),  using  a  greater  number  of  subjects, 
partially  replicated  the  finding  of  Ritchie  and  Michael  (1955).  Transfer  from 
instrument  to  contact  training  was  again  found  to  be  positive.  However,  non¬ 
significant  positive  transfer  effects  from  contact  to  Instrument  learning  also 
were  observed.  Not  surprisingly,  significantly  fewer  trials  (61%)  were 
required  to  learn  contact  than  instrument  flying,  a  result  suggested  by  the 
earlier  study.  This  finding  led  the  investigators  to  conclude  that  instrument 
flying  is  reliably  more  difficult  to  learn  than  contact  flying. 

A  methodological  weakness  in  these  studies  was  the  selection  of  only  two  basic 
tasks  (straight  and  level  flight  and  180°  turn  maneuvers)  on  which  to  obtain 
performance  measures.  There  is  a  question  as  to  vrtiether  findings  related  only 
to  these  tasks  can  be  generalized  to  all  the  interactive  cognitive,  proce¬ 
dural,  decisional,  and  psychomotor  skills  required  for  general  operation  of 
aircraft.  There  is  a  need  for  a  more  representative  range  of  flight  tasks 
before  such  generalizations  can  be  made  reliably. 

A  study  conducted  by  Williams,  Houston,  and  Wilkerson  (1956)  at  the  University 
of  Illinois  Institute  of  Aviation  addressed  the  feasibility  of  incorporating 
both  instrument  and  contact  flight  training  within  the  scope  of  the  private 
pilot  syllabus.  The  first  3.2  hours  of  training  were  spent  either  in  a  ground 
trainer  or  under  the  hood  In  the  aircraft.  Contact  flying  was  then  introduced 
and  interspersed  with  4nstrument  flying  thereafter.  All  the  subjects  passed 
the  private  pilot  checkride  and;  by  means  of  subjective  evaluations,  showed 
substantial  ability  to  engage  in  basic  instrument  flight.  Williams  et  al . 
noted  that  the  integrated  format  did  not  hamper  students'  contact  proficiency, 
that  they  were  enthusiastic  about  instrument  flying  and  motivated  to  learn 
more  about  it,  and  that  a  few  of  the  students  were  able  to  pass  the  basic  air- 
work  portion  of  a  standard  Instrument  checkride.  The  flight  Instructors  who 
served  In  the  project  felt  that  the  integrated  contact/instrument  concept 
should  be  incorporated  into  all  private  pilot  training  programs. 

Seltzer  (1958),  at  West  Virginia  University,  conducted  a  study  with  ten  sub¬ 
jects  to  determine  whether  they  could  be  trained  effectively  as  private  pilots 
in  a  course  combining  Instrument  and  contact  flight  training.  All  subjects 
passed  the  private  checkride  after  training  times  not  appreciably  greater  than 
students  normally  required  at  that  school.  Of  the  ten  experimental  subjects, 
two  participated  in  another  20  hours  of  Instrument  training  after  which  they 
took  standard  instrument  checkrides.l  One  of  the  students  passed  the  flight 


These  students  did  not  meet  the  experience  and  training  requirements  as 
prescribed  by  the  FAA  for  the  Instrument  rating.  As  described  in  this  report, 
those  requirements  include  200  hours  of  total  flight  time  and  40  hours  of 
instrument  time  under  actual  or  simulated  conditions.  These  two  students  had 
approximately  65  total  flight  hours  and  25  Instrument  hours  upon  taking  their 
instrument  flight  check. 
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check.  The  FAA  examiner  vrfio  administered  the  ride  noted  that  this  student  was 
an  example  of  what  can  be  accomplished  with  carefully  controlled  training, 
high  Instructor  proficiency,  and  able  students.  The  other  student  failed  the 
checkrlde,  but  his  examiner  Indicated  that  a  few  more  hours  of  training  would 
likely  bring  him  up  to  full  Instrument  standards.  Seltzer  concluded  that  some 
Instrument  training  should  be  Included  In  the  Initial  phases  of  flight 
Instruction  since  such  training  appears  to  facilitate  both  contact  and  Instru¬ 
ment  skill  acquisition. 

Another  study  was  conducted  by  Seltzer  the  following  year  (Seltzer,  1959)  to 
determine  whether  a  relationship  existed  between  the  amount  of  contact  flying 
experience  of  general  aviation  pilots  and  the  amount  of  Instrument  Instruction 
required  to  develop  minimally  acceptable  Instrument  proficiency.  Sixty-six 
qualified  private  pilots  from  two  states  were  used  as  subjects.  A  five-point 
subjective  grade  scale  was  used  and  the  content  and  sequence  of  Instrument 
flight  checks  were  standardized.  Seltzer  found  no  relationship  between  pre¬ 
vious  contact  experience  and  the  learning  of  Instrument  flight  skills. 

A  study  was  performed  at  Ohio  State  University  to  determine  the  effects  of  an 
Integrated  VFR-IFR  curriculum  on  both  contact  and  Instrument  flying  skills 
(Easter  A  Hubbard,  1968).  The  integrated  curriculum  consisted  of  75  total 
flight  hours.  All  maneuvers  were  Introduced  using  Instrument  references,  with 
the  relationships  between  them  and  visual  references  emphasized.  Performance 
of  the  experimental  students  receiving  this  Integrated  training  was  compared 
statistically  to  that  of  private  pilot  and  instrument  pilot  control  groups  at 
various  points  during  the  training  sequence.  Both  objective  and  attltudlnal 
data  indicated  a  difference  slightly  In  favor  of  the  experimental  group  with 
regard  to  contact  flying  skills.  However,  Instrument  skills  of  the  experimen¬ 
tal  group  were  found  to  be  markedly  Inferior  to  those  of  the  Instrument 
control  group. 1  It  was  concluded  that  75  hours  of  flight  time  was  Insuf¬ 
ficient  to  train  the  "judgment,  self-reliance,  and  seasoning"  necessary  to 
operate  IFR  in  the  complex  ATC  network.  It  was  not  possible,  however,  to 
Identify  in  the  data  obtained  the  variable(s)  responsible  for  these  Instrument 
skill  deficiencies.  The  authors  presented  several  cogent  Interpretations  of 
their  results.  Including  the  lack  of  sufficient  solo  cross-country  time  by  the 
experimental  group,  possible  Instructor  recording  differences,  and  a  lack  of 
sufficient  training  time  and  content  relative  to  the  complex  time-shared 
aspects  of  Instrument  flying. 

Like  most  of  the  work  preceding  it,  the  design  of  the  Easter  and  Hubbard 
( 1968 )  study  permitted  neither  definitive  explanations  concerning  why  signifi¬ 
cant  differences  were  obtained,  nor  reliable  estimates  of  additional  time 
necessary  to  bring  the  experimental  group  up  to  FAA  Instrument  rating  stan¬ 
dards.  The  present  study  attempted  to  overcome  some  of  the  methodological 
deficiencies  of  past  attempts.  It  was  recognized,  however,  that  many  such 
deficiencies  are  Inherent  In  attempts  to  gather  performance  data  of  this 
nature  within  operational  settings. 


The  instrument  control  group  consisted  of  15  students  vtoose  mean  total 
flight  time  at  the  beginning  of  the  project  was  367  hours,  a  confounding 
variable  as  reported  by  the  authors  because  the  experimental  subjects  began 
training  with  zero  prior  flight  hours. 
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MILITARY  AVIATION  RESEARCH  ON  INTEGRATED  TRAINING.  All  three  branches  of  the 
military  have  investigated  some  form  of  early  Integrated  contact/ Instrument 
training.  While  there  remains  some  controversy  as  to  how  much  and  what  type 
of  Instrument  training  Is  sufficient  to  produce  combat-ready  aviators,  there 
has  been  a  definite  trend  toward  Introducing  Instrument  skills  very  early  In 
the  training  sequence  and  reinforcing  the  use  of  those  skills  by  student 
pilots  throughout  training. 

The  Air  Force,  through  its  Primary  Flight  Training  Research  Unit  (1957),  con¬ 
ducted  an  experiment  at  Graham  AFB,  Marianna,  Florida,  In  1956-57  for  the  pur¬ 
pose  of  evaluating  the  integrated  training  concept.  Two  primary  pilot  classes 
were  trained  using  this  concept.  One  class  used  the  block  approach,  and  the 
other  the  simultaneous  (instrument/contact)  cue  method.  Data  consisted  of  the 
subjective  reports  of  the  participating  Instructors.  While  the  instructors 
generally  were  of  the  opinion  that  the  simultaneous  use  of  contact  and  Instru¬ 
ment  cues  resulted  in  Informational  overload  for  the  beginning  student,  the 
instructors  were  unanimous  In  their  desire  to  use  the  following  Instructional 
sequence: 


1.  Three  hours  of  ground  trainer  Instruction  to  teach  pitch,  bank,  and 
power  control . 

2.  Three  hours  of  pitch,  bank,  and  power  control  Instruction  in  the 
aircraft  under  the  hood. 

3.  A  contact  check  to  Include  solo  flight. 

4.  The  remainder  of  training  'using  the  simultaneous  cueing  method. 

Overall  conclusions  based  upon  subjective  flight  check  data  were  that  inte¬ 
grated  training  slightly  Improved  primary  pilot  performance;  that  the  simul¬ 
taneous  cue  method  is  capable  of  producing  a  level  of  proficiency  greater  than 
that  resulting  from  the  use  of  conventional  methods;  and  that  the  use  of  Inte¬ 
grated  concepts  should  be  extended  into  basic  (as  well  as  primary)  training  to 
promote  continuity. 

In  1957,  the  Army  Aviation  School  examined,  on  a  preliminary  basis,  the  feasi¬ 
bility  of  integrated  fixed-wing  training.  Investigators  and  training  mana¬ 
gers  were  sufficiently  optimistic  about  the  results  of  that  study  to  recommend 
that  a  larger-scale  assessment  of  Integrated  training  be  conducted.  In 
response  to  that  recommendation,  a  comprehensive,  well  controlled  study  of 
integrated  training  was  carried  out.  This  study,  known  as  INTACT,  was  per¬ 
formed  In  1960-61  by  the  Human  Resources  Research  Office  (HumRRO)  and  the 
results  were  published  by  Prophet  and  Jolley  ( 1 969 ) . 

The  major  purposes  of  INTACT  were  to  determine:  (1)  contact  and  instrument 
proficiency  levels  of  primary  flight  students  trained  under  an  Integrated  con¬ 
cept  relative  to  those  trained  using  standard  methods;  (2)  rates  of  attrition 
for  Integrated  and  non- Integrated  classes;  and  (3)  the  extent  to  which 
Integrated  training  effects  exhibited  during  the  early  phases  of  training 
would  be  demonstrated  during  advanced  contact  and  Instrument  training. 
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Three  groups  of  36  students  each  received  primary  flight  training  under  either 
Integrated  or  non- Integrated  methods.  The  performance  of  these  students  was 
compared  throughout  and  at  the  completion  of  training  using  objective 
measures.  Other  proficiency  measures  employed  In  this  study  were  attrition, 
training  time,  and  subjective  checkrlde  grades. 

Results  Indicated  no  significant  performance  differences  among  groups  using 
any  of  the  objective  measures  at  any  point  during  either  primary  or  advanced 
training.  The  subjective  numerical  checkrlde  grades  were  significantly  higher 
(j>  <  .05)  for  Integrated  groups  than  non-lntegrated  groups  during  primary 
training.  No  significant  differences  were  obtained  for  advanced  phases. 
Conclusions  were  that  Integrated  primary  flight  training  produces  advantages 
In  primary  flight  proficiency  but  that  those  advantages  are  not  manifest  in 
advanced  flight  performance. 

The  overall  body  of  research  data  concerned  with  Integrated  training  suggests 
that  it  might  be  poss1ble--even  likely— that  private  pilots  can  learn  Instru¬ 
ment  skills  that  meet  minimum  required  proficiency  levels  In  fewer  than  200 
hours  total  flight  time. 
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APPENDIX  B 


MISCELLANEOUS  DATA  FOR  SUBJECTS 


The  data  In  this  appendix  are  only  for  subjects  who  completed  the  experiment. 
The  data  Include:  (1)  sex  of  subject;  (2)  age  at  the  beginning  of  training; 
(3)  grade  point  average  ( GPA )  for  E-RAU  courses  102,  103,  and  203;  (4)  scores 
on  the  Private  Written  Examination  administered  just  before  the  contact 
checkride;  (5)  total  training  hours  when  exiting  from  instrument  training;  (6) 
pilot- In-command  time  up  to  the  instrument  checkride;  and  cross-country  time 
up  to  the  Instrument  checkride. 


TRACK  A  SUBJECTS 


Subject 

No. 

Sex 

Age 

6PA 

Private 
Wrl tten 
Score 

Instrument 
Training 
Exit  Hours 

“Cross- 

Country 

Time 

1 

F 

22 
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78 
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92 
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M 

20 

3.3 

88 
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13 

16 

M 

23 
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86 
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31 

20 

17 

M 

21 
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83 
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30 

15 

18 

M 

20 
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86 
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41 

20 

19 

M 

20 

2.6 

90 

110 

40 

21 

20 

M 

19 

2.7 

87 

no 

38 

18 

21 

M 

21 

2.8 

79 
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15 

22 

M 

27 

3.1 

92 
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37 

15 

23 

M 

22 

2.8 

85 

108 

31 

21 

24 

M 

21 
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78 
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32 

15 

25 

M 

19 
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95 
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25 

16 

26 

M 

20 
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88 
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40 

20 

27 

M 

26 

2.3 

70 
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35 

21 

Mean 

(11.11 

Female) 

20.93 

2.81 

83.59 

113.63 

- 

34.04 

16.52 

Standard 

Deviation 

2.09 

0.48 

6.15 

7.16 

4.00 

3.62 

TRACK  B  SUBJECTS 


Subject 

No. 

Sex 

Bl 

GPA 

i  TjTV 

Instrument 
Training 
Exit  Hours 

"TMTot'-"Tn'~ 

Command 

Time 

Cross- 

Country 

Time 

1 

M 

20 

2.8 

76 

■■ 

70 

30 

2 

M 

20 

3.8 

95 

75 

35 

3 

M 

20 

2.2 

92 

145 

92 

40 

4 

M 

24 

2.9 

82 

135 

70 

40 

5 

M 

19 

2.2 

76 

137 

70 

40 

6 

M 

19 

2.5 

77 

140 

75 

38 

7 

M 

19 

2.1 

75 

135 

74 

41 

8 

19 

2.8 

90 

145 

82 

39 

9 

22 

2.7 

75 

137 

80 

40 

10 

19 

3.0 

70 

130 

70 

42 

11 

99 

21 

2.0 

83 

146 

91 

45 

12 

99 

19 

3.6 

88 

131 

71 

43 

13 

99 

23 

3.5 

76 

137 

73 

39 

14 

M 

19 

2.4 

75 

145 

90 

45 

15 

M 

19 

3.3 

130 

72 

40 

16 

M 

21 

2.0 

79 

138 

83 

42 

17 

M 

19 

2.9 

75 

142 

90 

45 

18 

M 

20 

2.4 

85 

140 

68 

43 

19 

M 

21 

2.2 

72 

125 

79 

43 

20 

M 

19 

3.4 

93 

150 

70 

40 

21 

M 

20 

2.3 

81 

139 

82 

38 

22 

M 

22 

3.2 

78 

137 

75 

42 

23 

20 

3.2 

88 

142 

74 

42 

24 

99 

19 

3.1 

80 

139 

73 

37 

25 

99 

22 

3.6 

97 

140 

83 

41 

26 

9 

19 

2.9 

92 

145 

86 

43 

Mean 

Female) 

20.15 

2.81 

81.92 

138.46 

77.62 

40.50 

Standard 

Deviation 

1.43 

0.54 

7.66 

6.09 

7.52 

3.26 
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TRACK  C  SUBJECTS 


Subject 

No. 

Sex 

mi 

SPA 

'  "Prfvate " 
Written 
Score 

Instrument 
Training 
Exit  Hours 

TfTot-Tn-'" 

Command 

Time 

Cross- 

Country 

Time 

1 

M 

20 

2.9 

78 

183 

70 

41 

2 

M 

23 

2.6 

92 

180 

50 

35 

3 

M 

20 

2.5 

74 

164 

100 

45 

4 

M 

20 

2.5 

81 

162 

70 

50 

5 

M 

25 

2.6 

78 

183 

90 

65 

6 

M 

20 

2.0 

87 

166 

70 

40 

7 

M 

19 

2.6 

78 

169 

60 

45 

8 

M 

22 

3.3 

78 

■  ‘  168 

60 

40 

9 

M 

21 

3.5 

97 

175 

60 

45 

10 

M 

20 

2.5 

170 

70 

45 

11 

M 

26 

3.4 

175 

85 

35 

12 

M 

19 

2.1 

160 

75 

35 

13 

M 

21 

1.9 

162 

90 

41 

14 

F 

20 

1.8 

75 

177 

80 

35 

15 

M 

19 

2.1 

70 

169 

85 

42 

16 

F 

19 

2.0 

78 

165 

75 

45 

17 

F 

19 

2.3 

82 

168 

68 

45 

18 

M 

21 

2.9 

92 

167 

60 

35 

19 

M 

20 

2.2 

78 

172 

70 

30 

20 

M 

21 

2.2 

75 

163 

85 

50 

21 

M 

21 

2.4 

87 

162 

60 

40 

22 

M 

23 

2.2 

80 

176 

68 

42 

23 

M 

19 

2.0 

70 

177 

70 

41 

24 

M 

19 

2.3 

78 

178 

65 

40 

25 

F 

20 

1.8 

75 

181 

73 

43 

26 

M 

19 

2.0 

73 

180 

72 

38 

Mean 

lima 

20.62 

2.41 

79.46 

171.23 

72.35 

41.85 

Standard 

Deviation 

1.86 

0.47 

6.97 

7.23 

11.54 

6.74 
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APPENDIX  C 


STATISTICAL  ANALYSIS  PROCEDURES 


In  presenting  data  in  this  report,  several  types  of  statistics  are  used.  To 
summarize  the  general  nature  or  typical  value  for  a  group  of  measures, 
descriptive  statistics  such  as  the  Arithmetic  Mean  (M)  and  Standard  Deviation 
(SD)  are  used.  The  M  Is  that  statistic  which  is  commonly  referred  to  as  "the 
average,"  while  the  SD  is  an  indicator  of  the  degree  of  variability  among 
individual  measures  about  the  group  M  value. 

In  evaluating  whether  two  or  more  sets  of  data  (e.g..  Groups  A,  B,  and  C) 
differ  to  a  degree  greater  than  might  be  expected  by  chance,  various  statisti¬ 
cal  significance  tests  are  used.  In  the  present  report,  these  are  the  "chi 
squared"  test  and  the  "analysis  of  variance  (ANOVA)." 

Degree  of  departure  from  chance  expectation  is  expressed  in  terms  of  probabil¬ 
ity  statements.  For  example,  the  expression  j)  <  .05  means  that  the  probabil¬ 
ity  Is  less  than  5  in  100  that  the  difference  Is  due  to  chance  alone;  p  <  .01 
means  that  the  probability  is  less  than  1  in  100;  etc.  Thus,  the  smaller  the 
probability  figure,  the  more  significant  a  difference  is  and  the  less  likely 
it  is  due  to  chance  variation.  In  keeping  with  statistical  convention,  dif¬ 
ferences  are  not  considered  statistical^  significant  here  unless  the  proba¬ 
bility  is  5  in  100  or  less. 

The  ANOVA  test  yields  a  statistic  called  the  ratio,  which  is  the  ratio  of 
two  variance  estimates,  and  it  is  this  F_  statistic  that  allows  the  probability 
determination.  Similarly,  the  chi  squared  test  yields  a  statistic  that  per¬ 
mits  a  probability  determination  of  the  significance  of  a  difference.  In  both 
the  ANOVA  and  chi  squared  tests,  reference  is  made  to  df,  or  degrees  of 
freedom.  The  df  refers  basically  to  the  number  of  independent  measures  on 
which  the  test  T?  based. 

The  reader  desiring  more  information  of  such  statistical  analysis  and  test 
procedures  is  referred  to  any  one  of  the  large  number  of  standard  statistical 
textbooks  available.  For  example,  see: 

Edwards,  A.  L.  Statistical  analysis.  New  York:  Holt,  Rinehart,  4  Winston, 
1974. 

McNemar,  0.  Psychological  statistics.  New  York:  John  Wiley  4  Sons,  1969. 

Runyan,  R.  P.,  4  Haber,  A.  Fundamentals  of  behavioral  statistics.  Reading, 
MA:  Addison-Wesley,  197H 
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APPENDIX  D 


PILOT  PERFORMANCE  DESCRIPTION  RECORD  (PPDR) 
FOR  THE  CONTACT  CHECKRIDE 


This  appendix  presents  materials  for  the  Contact  Checkrlde  PPDR  as  they  were 
adapted  for  the  present  experiment.  Four  Items  are  Included.  First,  the 
Handbook,  which  begins  on  page  D-2,  describes  the  PPDR  and  gives  Instructions 
for  Its  use.  Second,  performance  measure  definitions  and  guidelines  for 
recording  data  begin  on  page  D-7.  Third,  the  syllabus  for  training  the 
checkpllots  to  use  the  PPDR  is  outlined,  beginning  on  page  D-ll.  Fourth,  the 
PPDR  forms  used  for  recording  begin  on  page  D-15. 
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Contact  Checkrlde  Handbook 


Pilot  Performance  Description  Record  (PPDR) 


I.  Purpose 

A.  General  -  to  provide  a  method  of  clearly  describing  and  documenting 
student  pilot  performance 

B.  Specific  -  to  provide  objective  performance  data  for  evaluating 
Contact  performance  of  students  In  various  training  tracks. 

II.  Guiding  Principles 

A.  to  obtain  a  maximum  of  descriptive  and  specific  judgmental  Infor¬ 
mation  with  a  minimum  of  Inflight  marking 

B.  to  be  made  compatible  with  existing  FAA  and  E-RAU  checkrlde  proce¬ 
dures 

C.  to  provide  a  snapshot  sample  of  student  performance  of  those  flying 
skills  required  to  pass  the  Private  Pilot  Checkrlde. 

III.  PPDR  Characteristics  and  General  Utilization 

A.  Each  flight  maneuver  In  this  PPDR  has  been  analyzed  and  discussed 
with  E-RAU  personnel  to  determine  Its  fundamental  components.  The 
analyses  provided  the  basis  for  the  development  of  descriptive  and 
judgmental  scales  on  which  each  performance  component,  such  as  direc¬ 
tion,  attitude,  power,  and  flight  path,  could  be  quickly  described  by 
the  checkpllot. 

B.  This  PPDR  Includes  a  sample  of  the  maneuvers  described  In  the  FAA 
flight  test  guide  on  which  proficiency  must  be  demonstrated  to  pass 
the  checkrlde  for  the  Private  Pilot  license.  This  PPDR  Is  Intended 
to  provide  descriptive  data  for  this  maneuver  sample  only,  and  as 
such.  It  should  be  viewed  as  a  part  of  the  checkrlde  and  not  as  a 
substitute  for  the  more  comprehensive  set  of  checkrlde  maneuvers 
prescribed  by  the  checkpllot.  Administration  of  this  PPDR  should  not 
restrict  or  constrain  the  checkpllot' s  usual  checkrlde  prerogatives. 
In  particular,  Inflight  safety  must  not  be  jeopardized.  Although  the 
sequence  of  PPDR  maneuvers  should  be  standardized  as  described  In  E. 
below.  It  Is  recognized  that  these  PPDR  maneuvers  will  be 
Interspersed  throughout  other  checkrlde  maneuvers.  The  performance 
description  resultlna  from  this  PPDR  Is  considered  to  be  as  complete 
as  can  be  obtained  efficiently  by  manual  recording  during  a  single 
flight  period. 
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C.  In  any  data  collection  effort,  reliability  (meaning  consistency  or 
repeatability  of  test  result),  and  validity  (meaning  measurement  of 
that  which  Is  intended  to  be  measured)  are  desirable  goals.  One 
necessary  factor  in  achieving  high  levels  of  reliability  and  validity 
is  standardization  of  the  test  sample,  test  conditions,  and  methods 
of  data  recording.  The  standardization  of  the  flight  test  sample  and 
the  methods  for  administering  and  evaluating  it  is  the  aim  of  the 
PPDR. 

0.  This  PPDR  is  separated  into  the  eight  major  maneuvers  to  be  recorded. 
Each  maneuver  is  divided  into  segments  that  specify  observations  that 
are  to  be  made  as  objectively  as  possible.  During  a  flight  check, 
student  performance  normally  is  recorded  during  or  near  the  end  of 
each  maneuver  segment,  provided  that  performance  is  within  the  limits 
specified  as  "proper"  on  all  scales  in  that  segment.  Whenever  an 
error  exceeding  "proper  limits"  of  a  scale  occurs,  the  checkpilot 
should  record  it  immediately,  regardless  of  how  much  of  the  segment 
is  completed.  If,  later  in  the  segment,  the  student  exceeds  his  pre¬ 
vious  error  on  the  same  scale,  the  checkpilot  makes  a  second  mark 
farther  out  on  the  scale.  Generally  speaking,  erratic  performance  is 
reflected  by  multiple  marking;  for  example,  if  the  descent  rate 
during  an  approach  is  uneven,  both  "slow"  and  "fast"  may  be  marked. 

E.  There  are  three  general  levels  of  detail  represented  in  the  PPDR: 
(1)  individual  performance  measures,  (2)  flight  segments,  and  (3) 
maneuvers.  Segments  and  measures  are  listed  in  the  approximate 
sequence  in  which  they  occur  during  execution  of  the  maneuver.  This 
is  intended  to  simplify  and  standardize  inflight  data  recording. 

Individual  Performance  Measures.  The  PPDR  measuring  scales  show 
the  detailed  and  descriptive  criteria  of  student  performance  which 
underlie  the  evaluation  made  by  the  checkpilot.  Examples  of  these 
scales  are  RPM,  airspeed,  altitude,  and  ground  track.  These  scales 
are  recorded  objectively  by  the  checkpilot  from  instruments  or 
clearly  definable  outside  references.  However,  it  is  not  always 
possible  to  find  such  outside  references  for  certain  crucial  aspects 
of  student  performance.  Consequently,  a  few  scales  are  judgmental  in 
nature,  e.g.,  pattern  exit  or  control  smoothness.  The  checkpilot 
must  use  his  judgment  In  evaluating  and  recording  these  items. 

Flight  Segments.  The  subdivision  of  each  PPDR  flight  maneuver 
into  its  segments  is  indicated  by  single  horizontal  lines  between 
segments.  The  segment  breaks  serve  to  remind  the  checkpilot  of  the 
time  required  for  that  particular  group  of  measures.  More  impor¬ 
tantly,  they  make  it  easier  for  the  checkpilot  to  focus  on  a  par¬ 
ticular  group  of  measures  for  the  specific  portion  of  flight 
performance  being  recorded.  This  reduces  the  difficulty  in  deter¬ 
mining  the  flight  performance  sample  to  which  each  measure  applies. 
Occasionally,  a  measure  refers  only  to  a  specific  part  (beginning  or 
end)  of  a  segment;  but  these  instances  will  be  obvious  to  the  check- 
pilot.  Segments  and  measures  are  sequenced  from  the  top  of  the  page 
to  the  bottom. 
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Maneuvers  There  are  several  factors  about  the  selected  flight 
maneuvers  that  the  PPDR  seeks  to  control.  One  factor  is  the  specifi¬ 
cation  of  performance  measures  and  segments  within  maneuvers.  The 
PPDR  also  requires  that  all  students  perform  identical  maneuvers, 
which  ensures  that  the  same  behavioral  patterns  are  sampled  in  all 
students.  Because  the  sequence  in  which  maneuvers  are  given  during  a 
flight  check  can  affect  the  results,  the  sequence  for  the  eight  PPDR 
maneuvers  has  been  stanoardized.  The  sequence  which  has  been  settled 
upon  should  allow  for  maximum  use  of  available  time  and  resources. 
Due  to  the  requirement  for  economy  of  time  and  effort  in  conducting 
the  checkride,  the  maneuver  performance  sequence  may  be  varied 
somewhat  to  expedite  or  to  ’ncrease  its  efficiency  or  convenience. 
However,  this  standardized  sequence  should  be  followed  as  closely  as 
possible.  All  maneuvers  must  be  completed  for  each  checkride.  The 
recommended  sequence  for  the  eight  PPDR  maneuvers  is: 

1.  Short  Field  Takeoff 

2.  Approach  Stall  Recovery 

3.  Slow  FI  ight 

4.  180°  Instrument  Turn 

5.  VOR  Procedures 

6.  Turns  About  A  Point 

7.  Traffic  Pattern 

8  Soft  Field  Landing 

PPDR  reliability  is  dependent  upon  the  degree  of  standardization 
achieved  in  administering  checkrides.  It  is  essential  that  every 
checkpilot  thoroughly  understand  each  measure  in  this  PPDR  as 
described  in  this  appendix.  In  addition  to  knowing  the  measure  defi¬ 
nitions,  it  is  important  that  the  checkpilot  clearly  understand  that 
he  has  two  roles,  evaluator  and  recorder.  In  his  normal  role  as 
evaluator,  the  checkpilot  observes  student  performance  throughout  the 
entire  checkride,  and  renders  his  assessment  of  the  efficacy  of 
issuing  a  Private  Pilot  license  on  the  basis  of  the  proficiency  that 
he  observes.  As  a  recorder,  he  is  asked  to  provide  accurate  and 
descriptive  information  on  the  observed  performance  as  it  occurs  and 
upon  which  his  evaluation  is  ultimately  based.  The  recording  func- 
tion  is  thus  extremely  critical  to  the  PPDR  data  collection  effort. 
To  achieve  the  goal  of  accuracy  and  completeness  of  recording,  the 
student's  performance  should  be  recorded  as  soon  after  it  occurs  as 
is  practical,  with  due  consideration  for  safety. 

The  checkpilot  should  maintain  an  impartial  attitude  toward  the  stu¬ 
dent,  limiting  conversation  to  explaining  checkride  requirements  and 
conditions. 
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H.  The  student  pilot  should  not  be  given  detailed  feedback  relative  to 
checkride  performance  prior  to  debriefing. 

I.  Measures  included  in  this  PPDR  are  of  two  types: 

1.  Performance  Scales  with  a  desired  range  of  values  indicated  by  a 
triangular  symbol  at  the  scale  midpoint,  and  errors  (e.g.,  left/ 
right)  to  either  side  of  the  triangle.  For  some  measures  a 
desired  value  is  specified  at  the  top  of  the  triangle.  Other 
measures  include  a  'O'  above  the  triangle,  indicating  that  the 
checkpilot  must  determine  the  correct  desired  value  depending 
upon  the  aircraft,  airspace,  or  prevailing  conditions. 

2.  Categorical  Measures  (yes  or  no)  requiring  the  checkpilot  to 
determine  whether  or  not  the  observed  performance  is  within 
acceptable  limits.  This  determination  involves  more  complex 
judgment  for  some  measures  (e.g.,  constant  turn  radius)  than 
others  (e.g.,  full  throttle). 

J.  For  the  scale  measures  that  include  a  specified  deviation  range 
(i.e.,  tolerance)  around  the  midpoint,  the  tolerance  band  specified 
may  or  may  not  be  identical  to  the  standards  given  in  the  FAA  flight 
test  guide.  These  bands  are  not  necessarily  intended  to  denote  FAA 
acceptable  performance,  but  rather  to  generate  accurate  data  to  docu¬ 
ment  observable  perfo’-mance  differences. 

K.  This  version  of  the  PPDR  is  not  intended  for  use  in  diagnosing  stu¬ 
dent  performance  deficiencies-  However,  research  has  shown  that  use 
o*  the  PPDR  can  lead  to  such  diagnosis  by  providing  instructors  and 
training  managers  with  a  valid  and  reliable  performance  data  base 
describing  typical  and  atypical  student  performance.  These  data  may 
then  be  used  as  an  index  of  comparison  (norm)  for  any  given  student's 
observed  performance,  and  therefore  provide  effective  performance 
feedback  to  that  student. 

IV.  PPDR  Data  Recording 

A.  The  cover  page  of  the  PPDR  is  divided  into  three  parts.  Part  One 
contains  descriptive  information  about  the  student,  checkpilot, 
aircraft,  etc.  and  should  be  completed  in  its  entirety  prior  to  the 
checkride.  Part  Two  contains  weather  data.  The  direction  and  velo¬ 
city  of  crosswind  as  well  as  existing  turbulence  should  be  recorded 
both  before  and  after  the  checkride.  Part  Three  includes  four  sub¬ 
jective  measures  of  pilot  skill.  Each  measure  should  be  slash  marked 
with  the  E-RAU  grade  which,  in  the  judgment  of  the  checkpilot,  best 
describes  the  overall  checkride  performance  of  the  student  on  that 
factor. 

B.  Each  scale  should  be  marked  with  at  least  one  slash  mark  of  approx¬ 
imately  1/4  inch  in  length.  The  mark  should  pass  clearly  and  evenly 
through  the  scale  such  that  there  is  no  doubt  about  which  scale  or 
which  portion  of  the  scale  the  checkpilot  intended  to  mark.  Cate¬ 
gorical  measures  should  include  a  slash  mark  in  the  appropriate  box. 
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C.  For  those  segments  encompassing  an  extended  period  of  time  (e.g., 
cllmbout  and  pattern  exit  after  takeoff),  multiple  marks  will  likely 
be  necessary.  This  gives  a  record  of  deviations  as  they  are  observed 
without  forcing  the  checkpllot  to  rely  upon  his  memory  of  an  extended 
performance  segment.  Errors  observed  In  both  directions  (e.g.,  low 
and  high)  should  be  appropriately  recorded.  Short  term  segments 
(e.g. ,  flare)  should  Include  only  one  mark  for  each  measure. 
Requirement  for  multiple  marking  should  be  apparent  to  checkpllots. 

D.  If  dangerous  performance  occurs,  the  checkpllot  should  write  a  letter 
"0"  In  the  left  margin  and  draw  a  line  to  the  scale(s)  reflecting  the 
dangerous  performance.  If  a  maneuver  is  aborted  because  of  student- 
induced  dangerous  performance,  an  additional  notation  should  be  made 
in  the  margin  and  all  remaining  measures  on  that  maneuver  marked  in 
error. 

E.  If  the  checkpilot  finds  it  necessary  to  assist  the  student  with  a 
maneuver,  "CP  Assist"  should  be  noted  in  the  margin  for  the  affected 
portion  of  the  maneuver  o r  segment. 

F.  Go-arounds  and  their  reason  should  be  noted  in  the  margin.  When  a 
go-around  is  initiated  for  any  -eason,  the  checkpilot  shall  note  the 
go-around  point  on  the  PPDR,  allow  one  additional  approach,  and  begin 
marking  at  the  point  of  go-around.  If  erratic  student  performance 
necessitates  a  second  go-around,  all  remaining  PPDR  measures  shall  be 
marked  in  error,  and  PPDR  recording  shall  terminate.  If  the  go- 
arounds  are,  in  the  judgment  of  the  checkpilot,  weather  or  traffic- 
induced,  a  notation  to  that  effect  should  be  made  in  the  margin,  and 
remaining  measures  left  unmarked. 

G.  The  checkpilot  should  mark  the  appropriate  E-RAU  grade  for  each  PPDR 
maneuver,  and  write  any  additional  comments  that  he  deems  pertinent 
to  the  recorded  performance  data  in  the  spaces  provided  at  the  bottom 
of  each  maneuver  form.  He  may  also  write  to  the  side  of  or  directly 
above  measures  or  segments,  time  and  space  permitting. 
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Performance  Measure  Definitions  and  Recording  Guidelines 


The  PPDR  provides  a  record  of  what  actually  occurs  during  the  checkrlde. 
The  maneuvers  Included  In  this  PPDR  are  Intended  to  be  performed  under  normal 
Private  Pilot  checkrlde  conditions  (l.e.,  no  more  than  light  to  moderate  wind 
and  turbulence  effects).  As  such,  the  PPDR  maneuvers  should  not  be  deliber¬ 
ately  assigned  under  extremely  windy  or  turbulent  conditions.  However,  If  It 
Is  necessary  to  administer  the  PPDR  In  such  conditions,  an  accurate  recording 
of  the  characteristics  of  those  conditions  before  and  after  the  checkrlde  will 
enable  them  to  be  considered  In  the  overall  analysis  of  performance.  The 
checkpllot  must  not  allow  extraneous  factors  to  Influence  his  marking  of  the 
actual  performance  scales. 

Measures  are  of  two  general  types.  One  Is  a  scale  with  a  triangle  (A) 
provided  at  its  midpoint.  The  triangle  should  be  marked  If  performance  Is 
within  non-error  limits  (l.e.,  proper) .  Otherwise,  deviations  from  these 
limits  should  be  marked  In  the  appropriate  error  direction  (e.g.,  low  or 
high).  Recording  should  not  attempt  to  reflect  the  exact  number  of  units  of 
deviation  from  the  midpoint  (e.g.,  7  Kts.  should  be  marked  at  any  point  be¬ 
tween  5  and  10  Kts.) 

The  other  measure  is  categorical ,  requiring  the  checkpllot  to  mark  either 
"yes"  or  "no"  depending  on  whether  the  observed  performance  relative  to  that 
measure  was.  In  his  judqment,  acceptable.  Measure  definitions  should  be 
followed  In  this  determination. 

A  Grade/Comment  section  Is  Included  at  the  end  of  each  maneuver.  Here 
the  checkpllot  should  enter  the  E-RAU  grade  (A,  B,  C,  D,  F)  that  best  des¬ 
cribes  the  overall  quality  of  the  maneuver  performance  recorded  in  the  PPDR, 
and  write  any  comments  that  he  feels  are  pertinent  to  the  performance.  He 
may  also  write  to  the  side  of  or  directly  above  measures  or  segments,  time  and 

space  permitting. 

Performance  Measures 


Abeam  Midpoint  -  On  traffic  pattern  entry,  mark  "Yes"  If  entry  Is,  within  an 
acceptable  range,  made  abeam  the  midpoint  of  the  runway;  otherwise,  mark  "Mo." 

Acceptable  Rotation  -  If  rotation  Is  acceptable,  mark  "Yes";  otherwise,  mark 
^NoT* 

Airspeed  -  If  observed  airspeed  Is  within  -*-5  knots  of  the  desired  airspeed, 
proper  should  be  marked;  otherwise  the  direction  and  magnitude  of  error  should 
be  marked. 

Altitude  -  If  observed  altitude  Is  within  +50  feet  of  desired  altitude,  mark 
proper;  otherwise,  mark  direction  and  magnitude  of  error. 


Altitude  Loss  Acceptable  -  A  measure  of  stall  recovery  skill,  mark  "Yes"  If 
altitude  loss  during  recovery  Is  not  excessive;  if  altitude  loss  Is  judged 
excessive,  mark  "No." 

Angle  (45°)  -  Traffic  pattern  entry  track  angle  should  be  marked  "Yes"  If 
entry  is  made  at  approximately  a  45°  angle;  otherwise,  mark  "No." 

Approach  Angle  -  If  the  approach  to  landing  Is  judged  to  be  within  approximate 
range  of  the  desired  approach  angle,  mark  proper;  otherwise,  mark  vrtiether  the 
angle  is  too  "shallow"  or  too  "steep." 

Bank  -  When  turning,  if  the  desired  bank  angle  is  maintained  within  +5°, 
proper  should  be  marked;  otherwise,  the  direction  and  magnitude  of  error 
should  be  marked. 

CARB  HEAT  OFF  -  Mark  "Yes"  or  "No"  as  appropriate. 

Cockpit  Check  -  If  all  required  cockpit  procedures  are  satisfactorily  per¬ 
formed,  mark  "Yes";  otherwise  mark  "No." 


Constant  Radius  Turn 


point, 

turns: 


mark 
If  the 


A  measure  of  wind  drift  correction  In  turns  about  a 
If  the  turn  radius  is  approximately  equal  throughout  both 


ground  path  Is  erratic 


© 


smooth  but  drift  corrections  are  Improper, 


or  if  the  turns  are 


mark  "No." 


Contact  -  Mark  proper  If  landing  contact  with  the  runway  Is  correctly  timed 
and  smooth;  otherwise,  mark  whether  the  aircraft  was  "dropped"  or  "bounced." 


Control  Coordination  -  A  measure  of  general  control  skill,  mark  "Yes"  If  stu¬ 
dent  maintains  coordinated  flight  (1.  1  ball)  during  turn.  Otherwise,  mark 
"No." 


Degrees  Turned  -  Mark  proper  If  the  observed  number  of  degrees  turned  is 
within  +5°  of  the  desired  number  of  degrees  turned;  otherwise,  mark  the  direc¬ 
tion  and  magnitude  of  error. 

Descent  Rate  -  If  the  observed  descent  rate  Is  judged  to  be  within  approximate 
range  of  the  desired  descent  rate,  mark  proper;  otherwise,  mark  the  direction 
of  error  ("slow"  or  "fast"). 


Distance  Out  -  Mark  proper  if  the  traffic  pattern  is  entered  at  the  correct 
distance  from  the  runway;  otherwise,  indicate  whether  entry  is  "too  close" 
or  "too  far"  from  the  runway. 

Enter  Downwind  -  Mark  "Yes"  if  entry  is,  within  acceptable  limits,  in  a  down- 
wlnd  direction;  otherwise,  mark  "No." 

Flaps  (10°)  -  Mark  "Yes"  or  "No"  as  appropriate. 

Full  Flaps  -  Mark  "Yes"  or  "No"  as  appropriate. 
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Full  Throttle  -  If  throttle  Is  full  open,  mark  "Yes";  any  throttle  setting 
less  than  full  should  be  marked  "No." 

Heading  -  Mark  proper  If  observed  heading  Is  within  +5°  of  desired  heading: 
otherwise,  mark  direction  and  magnitude  of  error. 

Level -off  Altitude  -  Traffic  pattern  or  assigned  level-off  altitude.  If 
achieved  within  1.50  feet,  should  be  marked  proper;  otherwise,  the  direction 
and  magnitude  of  error  should  be  marked. 

Maintain  Airspace  Scan  -  If  student  scans  (with  visible  head  movement)  for 
other  aircraft  while  executing  turns  about  a  point,  mark  "Yes";  otherwise, 
mark  "No." 

Mixture,  Full  Rich  -  Mark  "Yes"  or  "No"  as  appropriate. 

Pitch  Decreased  -  A  component  of  stall  recovery  skill,  mark  "Yes"  If  pitch  Is 
properly  and  Immediately  decreased  after  stall  occurs;  otherwise,  mark  "No." 

Power,  Idle  -  Mark  "Yes"  or  "No"  as  appropriate. 

Proper  Entry  Sequence  -  If  all  necessary  procedures  are  performed  In  the 
correct  sequence  during  entry  to  slow  flight,  mark  "yes".  If  any  procedure  Is 
omitted  or  out  of  sequence,  mark  "No". 

Proper  Flaps  -  If  the  flaps  are  set  In  the  desired  or  assigned  configuration, 
mark  "Yes’;  otherwise,  mark  "No." 

Proper  Flare  Attitude  -  Mark  proper  if  the  aircraft  Is  in  the  correct  nose-up 
pitch  attitude  during  the  flare;  otherwise,  mark  the  direction  of  error  ("nose 
low"  or  "nose  h*gh"). 

Proper  Flare  Rate  -  Mark  proper  if  the  flare  rate  Is  within  proper  limits; 
otherwise,  mark  whether  the  flare  was  too  "slow"  or  too  "fast." 

Proper  Ground  Track  -  If  the  aircraft  Is  maintained  within  an  acceptable  range 
of  the  desired  ground  track  throughout  a  segment,  mark  "Yes";  otherwise,  mark 
"No." 

Proper  Pattern  Exit  -  When  exiting  the  traffic  pattern,  mark  "Yes"  If  exit 
Is  timely,  at  the  proper  location,  altitude,  and  correct  angle.  If  any  one 
of  these  conditions  Is  not  satisfied,  mark  "No." 

Proper  Recovery  Sequence  -  If  all  necessary  procedures  are  performed  In  the 
correct  sequence  during  recovery  from  slow  flight,  mark  "Yes";  If  any  proce¬ 
dure  Is  omitted  or  out  of  sequence,  mark  "No". 

Radial  Identified  -  If  student  can  correctly  Identify  radial  and  orient  accor¬ 
dingly,  mark  "Yes";  otherwise,  mark  "No." 

Reduce  Power  -  If  power  is  reduced  within  a  proper  time  range,  mark  proper; 
otherwise,  mark  whether  power  was  reduced  too  "early"  or  too  "late"  in  the 
traffic  pattern. 
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RPM  -  If  the  desired  RPM  setting  is  maintained  within  +50  RPM,  proper  should 
be  marked;  otherwise,  the  direction  and  magnitude  of  error  should  be  marked. 

Runway  Centerline  Track  -  This  Is  a  measure  of  directional  control  during 
takeoff  and  landing  ground  roll  and  should  be  marked  proper  as  long  as  the 
runway  centerline  is  within  the  wing  tips.  Deviations  from  centerline  (-left,, 
or  "right")  should  be  marked  if  the  wlngtip  opposite  the  direction  of 
deviation  passes  the  runway  centerline. 

Smooth  Control  -  If  control  movements  are  judged  smooth  and  coordinated  for 
all  segments  of  the  maneuver,  mark  "Yes."  If  any  segment  contains  control 
movements  that  are  erratic,  of  excessively  large  magnitude  or  frequency,  or 
otherwise  unacceptable,  mark  "No." 

Stall  Recognized  -  Timely  and  correct  recognition  of  stall  should  be  marked 
"Yes";  otherwise,  mark  "No." 

Station  Identified  -  If  the  student  can  correctly  Identify  the  VOR  station 
within  an  acceptable  time  period,  mark  "Yes";  otherwise,  mark  "No." 

Station  Tuned  Properly  -  If  correct  VOR  station  is  correctly  tuned  within  an 
acceptable  time  period,  mark  "Yes";  otherwise,  mark  "No." 

Track  from  Extended  Runway  -  A  measure  of  track  control  after  liftoff  and 
during  approach  to  landing;  proper  should  be  marked  If  the  aircraft  track  Is 
maintained  within  an  acceptable  track  width  from  ground  level  to  an  altitude 
of  500  feet  or  until  a  turn  is  correctly  initiated.  If,  in  the  checkpllot's 
judgment,  proper  track  is  not  maintained  during  climbout  or  approach,  "left" 
or  "right"  should  be  marked. 

Touchdown  Point  -  If  the  aircraft  touches  down  within  an  acceptable  range  of 
the  touchdown  point,  mark  proper;  otherwise,  mark  whether  the  observed  touch¬ 
down  is  short  or  long  rel ative  to  the  desired  or  assigned  touchdown  point 
range. 

Trim  -  A  measure  of  ability  to  trim  for  hands-off  flight,  mark  "Yes"  If  little 
or  no  control  is  required  to  maintain  level  flight;  otherwise,  mark  "No." 

Turn  to  Inbound  Heading  -  If  Inbound  heading  Is  achieved  within  +5®  of  that 
assigned,  mark  proper;  otherwise,  mark  the  direction  and  magnitude  oT  error. 

Turn  Started  -  A  measure  of  traffic  pattern  skill,  mark  proper  If  the  turn 
Is  initiated  within  an  acceptable  distance  of  the  desired  or  assigned  turning 
point;  otherwise,  mark  whether  the  turn  was  Initiated  too  "early"  or  too 
"late." 

VOR  Track  -  Mark  proper  If  the  CDI  needle  Is  maintained  within  +  one  dot  of 
the  circle  for  the  duration  of  the  track;  otherwise,  mark  the  direction  and 
magnitude  of  error. 
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Contact  PPDR 


E-RAU  Checkpilot  Training  Program 


1.  Purpose  -  to  describe  and  explain  the  purpose,  objectives,  and  correct 
usage  of  the  Contact  PPDR  to  the  E-RAU  checkpilots  participating  in  the 
NAFEC  data  collection  effort. 

2.  This  training  program  is  designed  to  standardize  and  qualify  the  check- 
pilots  in  the  use  of  the  Contact  PPDR. 

3.  The  recommended  training  sequence  should  be  followed  as  closely  as 
possible  in  training  the  checkpilots  in  the  use  of  the  PPDR. 

4.  The  inflight  PPDR  training  should  be  conducted  during  the  course  of  regu¬ 
larly  scheduled  student  flights  in  the  Cessna  172  aircraft.  More  than  one 
airspace  and  traffic  pattern  should  be  used  if  possible. 


TRAINING  SEQUENCE  FOR  CONTACT  PPDR 


i - r 

- 

l 

ImeIHrs.) 

Activity 

uostfm 

■ULiTuliJ 

UUDfl 

i 

Explain: 

1.  General  background  and 
purpose  of  PPDR 

2.  Format  of  Contact  PPDR 

3.  Use  of  Contact  PPDR 

2.0 

0 

2.0 

2 

Practice  Contact  PPDR  data 
recording 

0.5 

1.0 

3.5 

3 

Practice  Contact  PPDR  data 
recording 

0.5 

1.0 

5.0 

4 

Practice  Contact  PPDR  data 
recording 

0.5 

1.0 

6.5 

5 

Practice  Contact  PPDR  data 
recording 

0.5 

1.0 

8.0 

6 

Practice  Contact  PPDR  data 
recording 

0.5 

1.0 

9.5 

7 

1.  Review  practice  recordings 

2.  Review  procedure  as  re¬ 
quired 

1.0 

0 

10.5 

aF11ght  times  are  estimates.  Actual  time  will  be  the  times  required 
for  regularly  scheduled  Instructional  events. 
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5.  To  the  extent  possible.  It  Is  desired  that  each  checkpllot  score  each 
maneuver  at  least  once  each  day  during  days  2-6.  Thus,  over  the  five-day 
flight  training  period,  a  minimum  of  five  recordings  for  each  maneuver  for 
each  checkpllot  Is  desired.  If  a  given  training  day  includes  more  than 
the  necessary  number  of  PPDR  training  hours,  it  is  requested  that  PPDR  use 
occur  within  each  hour,  if  possible.  Multiple  flights  on  one  day  should 
not  be  substituted  for  multiple  (at  least  five)  training  days. 

6.  Materials  -  the  checkpllots  will  have.  In  addition  to  all  required  E-RAU 
train inq materi al s : 

A.  Contact  PPOR  Handbook 

B.  Contact  PPDR  Folder 

C.  Ten  copies  of  Contact  PPDR 

7.  General  Training  Instructions  -  Each  checkpllot  should  include  In  his 
Contact  PPDR  folder  a  dally  comment  slip  with: 

A.  Information  concerning  PPDR  training  accomplished 

B.  Any  problem  areas  noted  In  data  recording 

Additionally,  each  PPDR  used  during  training  flights  should  be  dated  and 
filed  in  chronological  sequence.  The  training  coordinator  should  be 
available  before  and  after  training  flights  to  handle  any  questions  or 
problems  the  checkpilots  might  have. 

8.  Training  Schedule  - 

The  following  dai’y  training  schedule  should  be  followed  as  closely  as 
possible: 


Training  Day  1 

A.  Issue  appropriate  materials 

B.  Explain  and  discuss  (using  Handbook): 

1.  General  background  and  purpose  of  PPDR 

•  Standardization  •  Reliability  •  Description/Diagnosis 

•  Validity  •  Objectivity  •  Recording/Evaluating 

e  Use  by  other  •  Safety-oriented  •  Sequential  recording 

agencies 

•  Guiding  principles  of  PPDR 
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C.  Format  of  Contact  PPDR 

t  Maneuver  selection  rationale  •  Maneuvers/Segments/Measures 

•  Types  of  measures  •  Tolerance  band  rationale 

0.  Use  of  Contact  PPDR 

•  Marking  the  scales  •  Hiltlple  vs.  single  •  Omitted  scales 

marks 


•  Dangerous  performance  •  CP  assist 

•  Weather  factors  •  Grade/Comments 


•  Go-Arounds 

•  No  instruction 


Training  Days  2-6 

A.  The  previous  training  session  should  be  reviewed  each  day. 

B.  Each  checkpilot  should  record  student  performance  using  the  Contact 
PPDR  (1.0  hr.  each  day). 

C.  The  training  flight  should  be  as  similar  as  possible  to  a  standard 
checkrlde  without  interference  with  regularly  scheduled  instructional 
activities.  Maneuver  sequencing  can  be  varied  to  fit  the  instruc¬ 
tional  situation. 

D.  Emphasis  should  be  placed  upon  accurate  and  timely  scale  entries  for 
all  PPDR  measures. 

E.  The  training  coordinator  should  monitor  each  Contact  PPDR  folder  daily 
to  ensure  that: 

1.  PPDR  forms  are  correctly  marked  and  filed 

2.  Daily  comment  slips  are  included 

3.  Problems  noted  on  the  comment  slips  are  addressed 

F.  At  the  completion  of  Training  Day  6,  each  Contact  PPDR  folder  should 
be  carefully  inspected  and  turned  in  to  the  training  coordinator. 


Training  Day  7 

A.  The  training  coordinator  win  review  overall  experience  with  the  prac¬ 
tice  recordings  with  the  checkpilot. 

B.  Corrections  or  changes  in  procedures  will  be  discussed,  as  appropriate. 

C.  Final  guidelines  for  PPDR  administration  will  be  given. 
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Post-Training  Days 


Checkpllots  should  use  the  PPOR  In  conjunction  with  regularly  scheduled 
flying  activities  with  frequency  sufficient  to  ensure  their  retention  of 
administrative  skills  until  actual  data  collection  begins. 


I 

I 

I 


CONTACT 
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1.  Enbry-Riddle  Aaronauttcil  University 
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am 
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am 

D-23 


SOFT  FIELD  LANDING 


TRANSITION  (FURE) 

ALTITUOE 
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_ 1 

20 
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1 

PROPER  FLARE  RATE 

rwn 

DM3 

PROPER  FLARE  ATTITUDE  PPH 
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TOUCHDOWN 

TOUCHDOWN 

SHORT 

.  ^  . 

LONG 

POINT 

PROPER  POWER 

CM3 

PROPER  NOSE 
ATTITUOE 

CM3 

nrm 

CONTACT 

DROP 

■  ^  ■ 

bounce 

RUNMAT 

CENTERLINE 

LEFT 

RIGHT 

TRACK 

SMOOTH  CONTROL 

CM3 

rrrn 

GRADE  1  A 1  »  1  C  I  P  I  FI  TURBULENCE  [JQ  fTCT! 
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APPENDIX  E 


PILOT  PERFORMANCE  DESCRIPTION  RECORD  (PPDR) 
FOR  THE  INSTRUMENT  CHECKRIDE 


This  appendix  presents  materials  for  the  Instrument  Checkride  PPDR  as  they 
were  adapted  for  the  present  experiment.  Three  Items  are  included.  First, 
the  Handbook,  which  begins  on  page  E-2,  describes  the  PPDR  and  gives  Instruc¬ 
tions  for  its  use.  Second,  performance  measure  definitions  and  guidelines  for 
recording  data  begin  on  page  E-7.  The  PPDR  forms  used  for  recording  perfor¬ 
mance  begin  on  page  E-ll.  The  syllabus  for  training  checkpilots  to  use  the 
PPDR  is  the  same  as  that  for  contact  checkpilots.  An  outline  of  the  syllabus 
appears  in  Appendix  D,  beginning  on  page  D-ll. 
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Instrument  Checkrlde  Handbook 


Pilot  Performance  Description  Record  (PPDR) 


I .  Purpose 

A.  General  -  to  provide  a  method  of  clearly  describing  and  documenting 
student  pilot  performance 

B.  Specific  -  to  provide  objective  performance  data  for  evaluating 
Instrument  performance  of  E-RAU  students  In  various  training  tracks. 

II.  Guiding  Principles 

A.  to  obtain  a  maximum  of  descriptive  and  specific  judgmental  Infor¬ 
mation  with  a  minimum  of  inflight  marking 

B.  to  be  made  compatible  with  existing  FAA  and  E-RAU  Instrument 
checkrlde  procedures 

C.  to  provide  a  representative  sample  of  student  performance  of  those 
flying  skills  required  to  pass  the  Instrument  Checkrlde. 

III.  PPDR  Characteristics  and  General  Utilization 

A.  Each  flight  maneuver  In  this  PPDR  has  been  analyzed  and  discussed 

with  E-RAU  personnel  to  determine  Its  fundamental  components.  The 

analyses  provided  the  basis  for  the  development  of  descriptive  and 
judgmental  scales  on  which  each  performance  component,  such  as 

direction,  attitude,  power,  and  flight  path,  could  be  quickly 

described  by  the  checkpllot. 

B.  This  PPDR  includes  a  sample  of  the  maneuvers  described  In  the  FAA 
flight  test  guide  on  *rfi1ch  proficiency  must  be  demonstrated  to  pass 
the  checkrlde  for  the  Instrument  rating.  This  PPDR  Is  Intended  to 
provide  descriptive  data  for  this  maneuver  sample,  and  as  such, 
should  be  viewed  as  part  of  the  checkrlde.  Administration  of  this 
PPDR  should  not  restrict  or  constrain  the  checkpllot' s  usual 
checkrlde  prerogatives.  In  particular,  Inflight  safety  must  not  be 
jeopardized.  Although  the  sequence  of  PPDR  maneuvers  should  be 
standardized  as  described  In  E.  below.  It  Is  recognized  that  these 
PPDR  maneuvers  will  be  Interspersed  throughout  other  checkrlde 
maneuvers.  The  performance  description  resulting  from  this  PPDR  Is 
considered  to  be  as  complete  as  can  be  obtained  efficiently  by 
manual  recording  during  a  single  flight  period. 

C.  In  any  data  collection  effort,  reliability  (meaning  consistency  or 
repeatability  of  test  result)  and  validly  (meaning  measurement  of 
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that  which  Is  Intended  to  be  measured)  are  desirable  goals.  One 
necessary  factor  In  achieving  high  levels  of  reliability  and  vali¬ 
dity  Is  standardization  of  the  test  sample,  test  conditions,  and 
methods  of  data  recording.  The  standardization  of  the  flight  test 
sample  and  the  methods  for  administering  and  evaluating  It  Is  the 
aim  of  the  PPDR. 

This  PPOR  Is  separated  Into  a  number  of  Instrument  maneuvers  to  be 
recorded.  Each  maneuver  Is  divided  Into  segments  that  specify 
observations  that  are  to  be  made  as  objectively  as  possible.  During 
a  flight  check,  student  performance  normally  Is  recorded  during  or 
near  the  end  of  each  maneuver  segment,  provided  that  performance  Is 
within  the  limits  specified  as  "proper"  on  all  scales  In  that 
segment.  Whenever  an  error  exceeding  "proper  limits"  of  a  scale 
occurs,  the  checkpllot  should  record  It  Immediately,  regardless  of 
how  much  of  the  segment  Is  completed.  If,  later  In  the  segment,  the 
student  exceeds  his  previous  error  on  the  same  scale,  the  checkpllot 
makes  a  second  mark  farther  out  on  the  scale.  Generally  speaking, 
erratic  performance  Is  reflected  by  multiple  marking;  for  example  If 
the  descent  rate  during  an  approach  Is  uneven,  both  "slow"  and 
"fast"  may  be  marked. 

There  are  three  general  levels  of  detail  represented  In  the  PPDR: 
(a)  Individual  performance  measures,  (2)  flight  segments,  and  (3) 
maneuvers.  Segments  and  measures  are  listed  In  the  approximate 
sequence  In  which  they  occur  during  execution  of  the  maneuver.  This 
Is  Intended  to  simplify  and  standardize  inflight  data  recording. 

Individual  Performance  Measures.  The  PPDR  measuring  scales 
show  the  detailed  and  descriptive  criteria  of  student  performance 
which  underlie  the  evaluation  made  by  the  checkpllot.  Examples  of 
these  scales  are  airspeed,  altitude  and  ground  track.  These  scales 
are  recorded  objectively  by  the  checkpllot  from  Instruments  or 
clearly  definable  outside  references.  However,  It  Is  not  always 
possible  to  find  such  outside  references  for  certain  crucial  aspects 
of  student  performance.  Consequently,  a  few  scales  are  judgmental 
In  nature,  e.g.,  control  smoothness.  The  checkpllot  must  use  his 
judgment  In  evaluating  and  recording  these  Items. 

Flight  Segments.  The  subdivision  of  each  PPDR  flight  maneuver 
Into  Its  segments  Is  Indicated  by  single  horizontal  lines  between 
segments.  The  segment  breaks  serve  to  remind  the  checkpllot  of  the 
time  required  for  that  particular  group  of  measures.  More  Impor¬ 
tantly,  they  make  It  easier  for  the  checkpllot  to  focus  on  a  par¬ 
ticular  group  of  measures  for  the  specific  portion  of  flight 
performance  being  recorded.  This  reduces  the  difficulty  In  deter¬ 
mining  the  flight  performance  sample  to  which  each  measure  applies. 
Occasionally,  a  measure  refers  only  to  a  specific  part  (beginning  or 
end)  of  a  segment,  but  these  Instances  will  be  obvious  to  we  check- 
pllot. 

Segments  and  measures  are  sequenced  from  the  top  of  the  page  to  the 
bottom . 
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Maneuvers.  There  are  several  factors  about  the  selected  flight 
maneuvers  that  the  PPDR  seeks  to  control .  One  factor  Is  the  speci¬ 
fication  of  performance  measures  and  segments  within  maneuvers.  The 
PPDR  also  requires  that  all  students  perform  Identical  maneuvers, 
which  ensures  that  the  same  behavioral  patterns  are  sampled  In  all 
students.  Because  the  sequence  In  which  maneuvers  are  given  during 
a  flight  check  can  affect  the  results,  the  sequence  for  the  PPDR 
maneuvers  will  be  standardized.  The  sequence  settled  upon  should 
allow  for  maximum  use  of  available  time  and  resources.  Due  to  the 
requirement  for  economy  of  time  and  effort  In  conducting  the 
checkrlde,  the  performance  sequence  of  certain  maneuvers  may  be 
varied  to  expedite  or  to  Increase  Its  efficiency  or  convenience. 
However,  the  standardized  sequence  should  be  followed  as  closely  as 
possible.  All  maneuvers  must  be  completed  for  each  checkrlde. 

F.  PPDR  reliability  is  dependent  upon  the  degree  of  standardization 
achieved  in  administering  the  Instrument  checkrldes.  It  Is  essen¬ 
tial  that  every  checkpliot  thoroughly  understand  each  measure  In 
this  PPDR  as  described  In  this  appendix.  In  addition  to  knowing  the 
measure  definitions,  it  Is  Important  that  the  checkpliot  clearly 
understand  that  he  has  two  roles,  evaluator  and  recorder.  In  his 
normal  role  as  evaluator,  the  checkpliot  observes  student  perfor¬ 
mance  throughout  the  entire  checkrlde,  and  renders  his  assessment  of 
the  efficacy  of  Issuing  the  Instrument  rating  on  the  basis  of  the 
proficiency  that  he  observes.  As  a  recorder,  he  Is  asked  to  provide 
accurate  and  descriptive  Information  on  the  observed  performance  as 
It  occurs  and  upon  which  his  evaluation  Is  ultimately  based.  Tfie 
recording  function  Is  thus  extremely  critical  to  the  PPDR  data 
collection  effort.  To  achieve  the  goal  of  accuracy  and  completeness 
of  recording,  the  student's  performance  should  be  recorded  as  soon 
after  it  occurs  as  is  practical,  with  due  consideration  for  safety. 

G.  The  checkpliot  should  maintain  an  Impartial  attitude  toward  the  stu¬ 
dent,  limiting  conversation  to  explaining  checkrlde  requirements  and 
conditions. 

H.  The  student  pilot  should  not  be  given  detailed  feedback  relative  to 
checkrlde  performance  prior  to  debriefing. 

I.  Measures  included  In  this  PPDR  are  of  two  types: 

1.  Performance  Scales  with  a  desired  range  of  values  Indicated  by 
a  triangular  symbol  at  the  scale  midpoint,  and  errors  (e.g., 
left/ right)  to  either  side  of  the  triangle.  For  some  measures, 
a  desired  value  Is  specified  at  the  top  of  the  triangle.  Other 
measures  do  not  specify  a  desired  value.  Indicating  that  the 
checkpliot  must  determine  the  correct  desired  value  depending 
upon  the  aircraft,  airspace,  or  prevailing  conditions. 
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2. 


Categorical  Measures  (yes  or  no)  reauiring  the  checkpilot  to 
determine  whether  or  not  the  observed  performance  Is  within 
acceptable  limits.  This  determination  Involves  more  complex 
judgment  for  some  measures  (e.g.,  compliance  with  ATC 
Instructions)  than  others  (e.g.,  report). 

J.  For  the  scale  measures  that  Include  a  specified  deviation  range 
(l.e.,  tolerance)  around  the  midpoint,  the  tolerance  band  specified 
may  or  may  not  be  Identical  to  the  standards  given  In  the  FAA  flight 
test  guide.  These  bands  are  not  necessarily  intended  to  denote  FAA 
acceptable  performance,  but  rather  to  generate  accurate  data  to 
document  observable  performance  differences. 

K.  This  version  of  the  PPDR  Is  not  Intended  for  use  in  diagnosing  stu¬ 
dent  performance  deficiencies.  However,  research  has  shown  that  use 
of  the  PPDR  can  lead  to  such  diagnosis  by  providing  instructors  and 
training  managers  with  a  valid  and  reliable  performance  data  base 
describing  typical  and  atypical  student  performance.  These  data  may 
then  be  used  as  an  Index  of  comparison  (norm)  for  any  given  stu¬ 
dent's  observed  performance,  and  therefore,  provide  effective  per¬ 
formance  feedback  to  the  student. 

PPDR  Data  Recording 

A.  The  cover  page  of  the  PPDR  is  divided  into  three  parts.  Part  One 
contains  descriptive  information  about  the  student,  checkpllot, 
aircraft,  etc.  and  should  be  completed  in  its  entirety  prior  to  the 
checkrlde.  Part  Two  contains  weather  data.  The  appropriate  con¬ 
ditions  ( IFR  or  VFR)  as  well  as  existing  wind  speed  and  gust  should 
be  recorded  both  before  and  after  the  checkrlde.  Part  Three 
Includes  four  subjective  measures  of  pilot  skill.  Each  measure 
should  be  slash  marked  with  the  E-RAU  grade  which,  in  the  judgment 
of  the  checkpllot,  best  describes  the  overall  checkrlde  performance 
of  the  student  on  that  factor. 

B.  Each  scale  should  be  marked  with  at  least  one  slash  mark  of  approxi¬ 
mately  1/4  inch  in  length.  The  mark  should  pass  clearly  and  evenly 
through  the  scale  such  that  there  is  no  doubt  about  which  scale  or 
which  portion  of  the  scale  the  checkpllot  Intended  to  mark.  Cate¬ 
gorical  measures  should  include  a  slash  mark  in  the  appropriate  box. 

C.  For  those  segments  encompassing  an  extended  period  of  time  (e.g., 
bank  in  a  turn)  multiple  marks  may  be  necessary.  This  gives  a 
record  of  deviations  as  they  are  observed  without  forcing  the  check- 
pilot  to  rely  upon  his  memory  of  an  extended  performance  segment. 
Errors  observed  in  both  directions  (e.g.,  low  and  high)  should  be 
appropriately  recorded.  Short  term  segments  (e.g. ,  VOR  station 
passage)  should  include  only  one  mark  for  each  measure.  Requirement 
for  multiple  marking  should  be  apparent  to  checkpilots. 


D.  If  dangerous  performance  occurs,  the  checkpllot  should  write  a 
letter  “D"  In  the  left  margin  and  draw  a  line  to  the  scale(s) 
reflecting  the  dangerous  performance.  If  a  maneuver  Is  aborted 
because  of  student- Induced  dangerous  performance,  an  additional 
notation  should  be  made  In  the  margin  and  all  remaining  measures  on 
that  maneuver  marked  In  error. 

E.  If  the  checkpllot  finds  ft  necessary  to  assist  the  student  with  a 
maneuver,  "CP  Assist"  should  be  noted  In  the  margin  for  the  affected 
portion  of  the  maneuver  or  segment. 

F.  The  checkpllot  should  mark  the  appropriate  E-RAU  grade  for  each  PPDR 
maneuver,  and  write  any  additional  comments  that  he  deems  pertinent 
to  the  recorded  performance  data  In  the  spaces  provided  at  the  bot¬ 
tom  of  each  maneuver  form.  He  may  also  write  to  the  side  of,  or 
directly  above  measures  or  segments,  time  and  space  permitting. 

G.  Data  recording  for  each  PPDR  maneuver  should  be  complete.  If  cer¬ 
tain  measures  are  not  marked,  the  reason  for  the  Incomplete  form 
should  be  noted. 
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Instrument  PPDR 


Performance  Measure  Definitions  and  Recording  Guidelines 


The  PPOR  provides  a  record  of  what  actually  occurs  during  the  checkride. 
The  maneuvers  included  in  this  PPDR  are  intended  to  be  performed  under 
favorable  checkride  conditions  (i.e.,  no  more  than  light  to  moderate  wind  and 
turbulence  effects).  As  such,  the  PPDR  maneuvers  should  not  be  deliberately 
assigned  under  extremely  windy  or  turbulent  conditions.  However,  if  it  is 
necessary  to  administer  the  PPDR  n  such  conditions,  an  accurate  recording  of 
the  characteristics  of  those  concitions  before  and  after  the  checkride  will 
enable  them  to  be  considered  in  the  overall  analysis  of  performance.  The 

checkpilot  must  not  allow  extraneous  factors  to  Influence  his  marking  of  the 
actual  performance  scales. 

Measures  are  of  two  general  types.  One  is  a  scale  with  a  triangle  (  A  ) 
provided  at  midpoint.  The  triangle  should  be  marked  if  performance  is  within 
non-error  limits  (i.e.,  proper) .  Otherwise,  deviations  from  these  limits 
should  be  marked  in  the  appropriate  error  direction  (e.g.,  low  or  high). 

Recording  should  not  attempt  to  reflect  the  exact  number  of  units  of  deviation 
from  the  midpoint  (e.g.,  both  6  Kts  and  9  Kts  should  be  marked  midway  between 
5  and  10  Kts.) 

The  other  measure  is  categorical,  requiring  the  checkpilot  to  mark  either 
"yes"  or  "no"  depending  on  whether  the  observed  performance  relative  to  the 
measure  was,  in  his  judgment,  acceptable.  Measure  definitions  should  be 
followed  in  this  determination. 

A  Grade/Comment  section  is  included  at  the  end  of  each  maneuver.  Here 

the  checkpilot  should  enter  the  E-RAU  grade  (A,  B,  C,  D,  F)  that  best  des¬ 

cribes  the  overall  quality  of  the  maneuver  performance  recorded  In  the  PPDR, 
and  write  any  comments  that  he  feels  are  pertinent  to  the  performance.  He  may 
also  write  to  the  side  of,  or  directly  above  measures  or  segments,  time  and 
space  permitting. 

Performance  Measures 


Aircraft  Control  -  Mark  "Yes"  Is  confident  and  accurate  control  of  the 
aircraft  takes  priority  at  MAP;  If  preoccupation  with  other  tasks  or  hesita¬ 
tion  occurs,  mark  "No". 

Aircraft  Performance  Data  -  Mark  "Yes"  If  flight  manual  information  can  be 
accurately  appl led  to~  the  aircraft's  performance  characteristics  and 
capabilities;  otherwise,  mark  "No". 

Airspeed  -  If  observed  airspeed  is  within  IS  knots  of  the  desired  airspeed, 
proper  should  be  marked;  otherwise  the  direction  and  magnitude  of  error  should 
oe  marked. 
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Altitude  -  If  observed  altitude  is  within  ±50  feet  of  desired  altitude,  mark 
proper;  otherwise,  the  direction  and  magnitude  or  error  should  be  marked. 

Assigned  Airspeeds  Attained  -  Mark  "Yes"  if  all  assigned  airspeeds  are 
attained  within  +2  knots;  otherwise,  mark  "No". 

Avionics  -  Mark  "Yes"  if  student  can  demonstrate  the  skillful  use  of  radio 
communications  procedures  for  report,  ATC  clearances,  or  other  functions; 
otherwise  mark  "No". 

Rank  -  When  turning,  if  the  desired  bank  angle  is  maintained  within  ±5°, 
proper  should  be  marked;  otherwise,  the  direction  and  magnitude  of  error 
should  be  marked. 

CPI  Needle  Centered  -  Mark  "Yes"  If  the  CPI  needle  remains  within  the  doughnut 
during  orientation  otherwise,  mark  "No". 

Clearance  -  Mark  "Yes"  if  student  can  correctly  obtain  necessary  ATC  clearance 
prior  to  takeoff;  otherwise,  mark  "No". 

Compliance  with  All  ATC  Instructions  -  Mark  "Yes"  if  student  understands  and 
correctly  responds  to  all  ATC  instructions;  otherwise  mark  "No". 

Compliance  with  Part  91  and  AIM  Procedures  -  Mark  "Yes"  or  "No"  as  appropriate. 

Control  Coordination  -  A  measure  of  general  control  skill,  mark  "Yes"  if  stu¬ 
dent  maintains  coordinated  fliqht  (~  1  ball)  during  turn;  otherwise,  mark 
"No". 

Correct  and  Timely  Control  Movements  -  If  control  Inputs  are  both  correct  and 
timely  in  recovering  from  the  unusual  attitude,  mark  "Yes";  if  hesitation  or 
improper  inputs  are  observed,  mark  "No". 

Course  Tracking  (±2°)  -  Mark  "Yes"  if  track  is  maintained  within  ±2°  of 
desired  course;  otherwise,  mark  "No". 

Peqrees  Turned  -  Mark  proper  if  the  observed  number  of  degrees  turned  is 
within  ±56  of  the  desired  number  of  degrees  turned;  otherwise,  mark  the  direc¬ 
tion  and  magnitude  of  error. 

ETA  -  Mark  "Yes"  if  student's  ETA  is  within  ±3  minutes  of  actual  arrival; 
otherwise,  mark  "No". 

Flight  Log  -  Mark  "Yes"  If  flight  log  contains  all  Information  (e.g.,  enroute 
courses,  fuel  requirements,  estimated  ground  speeds,  ETE's)  pertinent  to 
selected  route;  otherwise,  mark  "No". 

Glide  Slope  (±J  dot)  -  Mark  "Yes"  if  glide  slope  is  maintained  within  —  1  dot 
of  doughnut;  otherwise  mark  "No". 

Initial  Altitude  Recovered  -  Mark  "Yes"  or  "No"  as  appropriate. 

Initial  Heading  Recovered  -  Mark  "Yes"  or  "No"  as  appropriate. 


Instruments  and  Equipment  -  Mark  "Yes”  If  student  can  thoroughly  and  accu- 
rately  perform  operation  checks  of  engine  instruments,  flight  Instrunents,  and 
avionics;  otherwise,  mark  "No". 

MDA  -  If  observed  altitude  on  final  approach  remains  within,  but  not  below  100 
feet  of  the  published  MDA,  mark  "Yes";  otherwise,  mark  "No". 

Pitch/Power  Coordination  -  Mark  "Yes"  if  aircraft  pitch  Is  properly  con¬ 
trolled  when  applying  power  for  airspeed  change;  otherwise,  mark  "No". 

Procedures  -  Mark  "Yes"  if  all  required  procedures  are  performed  in  an  accu- 
rate  and  timely  manner;  otherwise,  mark  "No". 

Proper  Entry  -  If  all  necessary  procedures  are  performed  in  the  correct 
sequence  during  entry  to  a  segment,  mark  "Yes";  if  any  procedure  is  omitted  or 
out  of  sequence,  mark  "No". 

Proper  Judgment  -  Mark  "Yes"  if  student  exhibits  proper  judgment  in  view  of 
the  situation  or  emergency;  otherwise,  mark  "No". 

Proper  Lead/Lag  -  Mark  "Yes"  if  rollout  on  mag  compass  turn  reflects  the 
correct  lead  or  lag  (15°)  for  the  assigned  heading;  otherwise,  mark  "No. 

Proper  Power  Change  -  Mark  "Yes"  if  the  power  change,  within  acceptable 
limits,  is  that  necessary  to  effect  the  desired  airspeed  change;  otherwise, 
mark  "No". 

Proper  Sequence  -  Mark  "Yes"  if  recovery  sequence  is  correct;  otherwise,  mark 
irRo1rI 

Proper  Setup  -  If  all  assigned  flight  variables  are  within  their  desired  range 
or  condition  upon  initiating  the  maneuver,  mark  "Yes";  otherwise  mark  "No". 

Proper  Timing  -  Mark  "Yes"  if  timing  for  all  legs  of  a  holding  pattern  is 
within  desired  limits;  otherwise  mark  "No". 

Proper  Turn  -  Mark  "Yes"  if  the  turn  is  initiated  and  terminated  at  the  proper 
time,  and  executed  at  the  proper  rate;  otherwise,  mark  "No". 

Radio  Calls  -  Mark  "Yes"  if  student  demonstrates  all  necessary  radio  communi- 
cations  prior  to  takeoff;  otherwise,  mark  "No". 

Recognition  of  Attitude  -  If  student  recognized  aircraft  attitude  upon  taking 
the1  control s ,  mark  "Tes";  if  control  movements  Indicate  that  the  aircraft 
attitude  has  not  been  recognized,  mark  "No". 

Report  -  Mark  "Yes"  if  student  gives  accurate  and  timely  report  of  position 
and  intention  to  ATC;  if  student  forgets  to  report  or  gives  incorrect  infor¬ 
mation,  mark  "No". 

Reset  DG  -  Mark  "Yes"  if  directional  gyro  is  reset  accurately  prior  to  tuning 
a  station;  otherwise  mark  "No". 
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Rolled  Out  on  Course  -  Mark  "Yes"  if  turn  is  terminated  within  5°  of  the 
desired  course;  otherwise  mark  "No". 

Route  Selection  -  Mark  "Yes"  if  cross-country  route  selected  is  acceptable; 
otherwise,  mark  "No". 

Smooth  Control  -  If  control  movements  are  judged  smooth  and  coordinated  for 
all  segments  of  a  maneuver,  mark  "Yes".  If  any  segment  contains  control  move¬ 
ments  that  are  erratic,  of  excessively  large  magnitude  or  frequency,  or  other¬ 
wise  unacceptable,  mark  "No". 

Station  Tuned,  Identified  -  Mark  "Yes"  or  "No"  as  appropriate. 

Timely  and  Accurate  Response  to  Emergency  -  Mark  "Yes"  or  "No"  as  appropriate. 

Timely  Compliance  with  All  Procedures  -  Mark  "Yes"  if  all  missed  approach  pro- 
cedures  are  followed  without  hesitation;  otherwise,  mark  "No". 

Track  ( ILS ,  ADF)  -  Mark  "Yes"  if  heading  remains  within  ±2°  of  course  to  the 
station  during  the  entire  segment;  otherwise  mark  "No". 

Track  (VOR)  -  Mark  "Yes"  if  the  needle  remains  within  the  doughnut  during  the 
entire  segment;  otherwise,  mark  "No". 

Transponder  -  Mark  "Yes"  if  student  can  correctly  tune  the  assigned 
transponder  frequency  prior  to  takeoff,  otherwise,  Mark  "No". 

Vertical  Speed  -  Mark  "Yes"  if  observed  vertical  speed  is  within  150  fpm  of 
desired  vertical  speed  in  a  climb  or  descent;  otherwise,  mark  "No". 

Weather  Information  -  Mark  "Yes"  if  all  weather  Information  pertinent  to  the 
selected  route  is  obtained  and  analyzed;  otherwise,  mark  "No". 
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APPENDIX  F 


DAILY  PROGRESS  RECORD  (DPR)  FOR  INSTRUMENT  TRAINING 


This  appendix  presents  materials  for  the  DPR  that  was  used  to  record  perfor¬ 
mance  during  Instrument  training.  Three  Items  are  Included.  First,  the 
User's  Guide,  which  begins  on  page  F-2,  describes  the  DPR  and  gives  Instruc¬ 
tions  for  its  use.  Second,  the  performance  measures  to  be  Included,  and  spe¬ 
cific  Instructions  for  recording  them,  begin  on  page  F-5.  Third,  the  DPR 
forms  used  for  recording  performance  begin  on  page  F-7. 
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User's  Guide 


Daily  Progress  Record  (DPR) 


Instrument  Maneuvers 


I .  Purpose 

A.  The  purpose  of  the  DPR  is  to  record  and  document  the  attainment  of 
various  specified  performance  criteria  for  E-RAU  instrument  maneuvers 
and  procedures. 

B.  This  documentation  will  result  in  objective  performance  data  to  be 
used  in  the  assessment  of  Instrument  proficiency  of  those  E-RAU  stu¬ 
dents  receiving  three  different  amounts  of  Contact  training. 

II.  Principles 

The  DPR  is  intended 

A.  to  provide  a  descriptive  profile  of  performance  occurring  across 
training  days  without  requiring  excessive  "head-in-cockpi t"  recording 
time  by  instructors; 

B.  to  be  made  compatible  with  the  Instrument  PPDR  used  for  recording 
checkride  performance; 

C.  to  provide  a  means  of  depicting  the  rate  of  change  in  Instrument 
flying  skill  over  training  time. 

III.  Characteristics 

A.  The  maneuvers  and  procedures  included  in  this  DPR  are  representative 
of  those  described  in  the  FAA  Instrument  Test  Guide  on  which  E-RAU 
students  must  demonstrate  proficiency  to  obtain  the  instrument 
rating.  Each  maneuver  has  been  analyzed  with  respect  to  what  must  be 
accomplished  to  result  in  its  successful  performance.  These  perfor¬ 
mance  requirements  are  related  to  aircraft  state  and  may  be  observed 
and  recorded  in  a  relatively  objective  manner. 

B.  Use  of  this  DPR  should  not  restrict  or  otherwise  Interfere  with 
instruction.  The  DPR  is  a  research  tool  intended  for  performance 
measurement  purposes  only.  Instructors  should  employ  their  usual 
instructional  techniques. 

C.  Inflight  safety  must,  of  course,  take  precedence  over  all  other 
training  activities  Including  both  instruction  and  data  recording. 
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D.  The  DPR  maneuvers  will  likely  be  interspersed  throughout  other 
instrument  maneuvers.  DPR  data  recording  should,  therefore,  be  a 
part  of,  rather  than  an  addition  to,  each  daily  training  session. 
IV. 


IV.  Format 

A.  The  first  page  of  the  DPR  booklet  contains  descriptive  information 
concerning  the  student  and  instructor.  It  should  be  completed  prior 
to  beginning  DPR  data  recording.  Each  student  will  have  a  separate 
DPR  booklet  which  will  be  used  by  the  instructor  to  record  that  stu¬ 
dents'  data  throughout  instrument  training. 

B.  The  DPR  consists  of  maneuvers  (e.g..  Turns)  which  are  subdivided  into 
a  number  of  segments  (e.g.,  Roll  In)  and  measures  (e.g.,  Altitude). 
Each  measure  includes  either  a  qualitative  definition  or  quantitative 
tolerance  level.  Qualitative  definitions  are  given  in  the  appendix 
of  this  guide.  Quantitative  tolerance  levels  are  specified  beside 
the  appropriate  measures  in  the  DPR.  An  example  of  a  measure  for 
which  a  qualitative  definition  is  required  is  "Proper  Setup." 
Quantitative  tolerance  levels  are  specified  for  such  measures  as 
"Altitude"  (±  50  ft)  and  "Airspeed"  (i  5  kts).  Measures  such  as 
Heading  and  Altitude  commonly  are  used  more  than  once  for  most  DPR 
maneuvers. 

V.  Data  Recording 

A.  In  marking  the  DPR,  the  instructor  must  ascertain,  solely  on  the 
basis  of  the  specified  definition  or  tolerance  level  for  each 
measure,  whether  the  observed  performance  satisfies  the  definition  or 
tol erence  level  for  that  measure.  If  the  measure  is  determined  to  be 
within  acceptable  limits,  a  check  (  /  )  is  marked  in  the  box  adjacent 
to  the  measure.  If  not  within  limits,  an  X  should  be  marked  in  the 
box.  No  allowances  should  be  made  for  extraneous  factors  (e.g., 
amount  of  training)  in  making  this  determination.  End-of-phase 
standards  should,  without  exception,  be  used  for  as~sessing  all 
maneuvers  and  measures. 

B.  Data  should  be  recorded  from  the  top  to  bottom  in  each  column 
although  columns  are  broken  according  to  segment.  The  top  box  In 
each  column  should  Include  a  different  training  date  (i.e.,  data 
recording  for  a  given  DPR  maneuver  should  occur  no  more  than  once  for 
a  given  training  day).  Further,  data  for  any  DPR  maneuver  should  be 
recorded  for  the  first  execution  of  the  maneuver  on  any  given  day. 
This  provides  some  control  for  practice  effects  and  hence,  increases 
the  validity  of  DPR  data. 

C.  Recording  for  DPR  maneuvers  should  be  complete  (I.e.,  if  the  first 
measure  of  any  column  contains  a  mark,  all  measures  of  that  column 
must  contain  a  mark).  If,  for  some  reason,  it  is  not  possible  to 
record  data  for  the  entire  maneuver,  reasons  for  the  Incomplete 
recording  should  be  noted  on  the  DPR  form. 


F-3 


AD-AQ99  4X4  EMBRY-RIDDLE  AERONAUTICAL  UNIV  DAYTONA  BEACH  FL  F/G  5/9 

THE  EFFECTS  OF  PILOT  EXPERIENCE  ON  ACQUIRING  INSTRUMENT  FLIGHT  — ETC(U> 
MAR  81  J  M  CHILDS*  W  W  PROPHET*  W  D  SPEARS  DOT-FA79NA-6040 

FAA-CT-81-38  NL 


UNCLASSIFIED 


MICROCOPY  RESOLUTION  TEST  CHART 


0.  With  due  consideration  for  Inflight  safety,  all  measures  should  be 
recorded  as  they  occur  during  the  execution  of  the  DPR  maneuver.  If 
It  Is  not  possible  to  mark  the  DPR  maneuver,  as  It  Is  being  per¬ 
formed,  this  should  be  done  as  soon  after  the  observed  performance  as 
possible.  This  decreases  reliance  on  memory,  and  Increases  data 
validity. 

E.  A  sample  of  a  correctly  recorded  DPR  maneuver  Is  shown  below. 
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Instrument  DPR 


DPR  Performance  Measure  Definitions  and  Recording  Guidelines 


Aircraft  Control  -  Insert  checkmark  If  confident  and  accurate  control  of  the 
aircraft  takes  priority  during  a  missed  approach;  if  preoccupation  with  other 
tasks  or  hesitation  occurs,  mark  X. 

Aircraft  Performance  Data  -  Insert  checkmark  if  flight  manual  information  can 
be  accurately  applied  to  the  aircraft's  performance  characteristics  and 
capabilities;  otherwise,  mark  X. 

All  A/S  Attained  -  Insert  checkmark  if  aVl.  assigned  airspeeds  are  attained 
with  +2  knots;  otherwise,  mark  X. 

Centered  Needle  -  Insert  checkmark  if  the  CDI  needle  remains  within  the  dough¬ 
nut  during  orientation;  otherwise,  mark  X. 

Clearance  -  Insert  checkmark  If  student  can  correctly  obtain  necessary  ATC 
clearance  prior  to  takeoff;  otherwise,  mark  X. 

Compliance  with  All  ATC  Instructions  -  Insert  checkmark  if  student  understands 
and  correctly  responds  to  all  ATC  instructions;  otherwise  mark  X. 

Compliance  with  All  Procedures  -  Insert  checkmark  if  student  complies  (timely 
and  accurately)  with  all  missed  approach  procedures;  otherwise,  mark  X. 

Compliance  with  Part  91  and  AIM  Procedures  -  Insert  checkmark  or  X  as 
appropriate. 

Coordination  -  A  measure  of  general  control  skill,  insert  checkmark  if  student 
maintains  coordinated  flight  (^.ball)  during  turn.  Otherwise,  mark  X. 

Correct  Number  of  Degrees  Turned  (±5°)  -  Insert  checkmark  if  actual  number  of 
degrees  turned  is  within  5°  of  desired  number  of  degrees  for  the  amount  of 
time  in  the  turn;  otherwise,  mark  X. 

Correct  and  Timely  Control  Movements  -  If  control  inputs  are  both  correct  and 
timely  in  recovering  from  the  unusual  attitude,  insert  checkmark;  if  hesita¬ 
tion  or  improper  inputs  are  observed,  mark  X. 

Course  Tracking  (+2°)  -  Insert  checkmark  if  track  is  maintained  within  +2*  of 
desired  course;  otherwise,  mark  X. 

Flight  Log  -  Insert  checkmark  If  flight  log  contains  all  Information  (e.g., 
enroute  courses,  fuel  requl rements ,  estimated  ground  speeds,  ETE's)  pertinent 
to  selected  route;  otherwise,  mark  X. 


Glide  Slope  (+1  dot)  -  Insert  checkmark  If  glide  slope  Is  maintained  within  +1 
dot  of  doughnut;  otherwise  mark  X. 

Instruments  and  Equipment  -  Insert  checkmark  If  student  can  thoroughly  and 
accurately  perform  operation  checks  of  engine  Instruments,  flight  Instruments, 
and  avionics;  otherwise,  mark  X. 

Procedures  -  Insert  checkmark  If  all  required  procedures  are  performed  In  an 
accurate  and  timely  manner;  otherwise,  mark  X. 

Position  Established  -  Insert  checkmark  If  student  correctly  establishes  posi¬ 
tion  relative  to  station  or  desired  course;  otherwise,  mark  X. 

Proper  Entry  -  If  all  necessary  procedures  are  performed  in  the  correct 
sequence  during  entry  to  a  segment.  Insert  checkmark;  If  any  procedure  Is 
omitted  or  out  of  sequence,  mark  X. 

Proper  Judgment  -  Insert  checkmark  if  student  exhibits  proper  judgment  In  view 
of  the  situation  or  emergency;  otherwise,  mark  X. 

Proper  Power  Change  -  Insert  checkmark  If  the  power  change,  within  acceptable 
limits.  Is  that  necessary  to  effect  the  desired  airspeed  change;  otherwise, 
mark  X. 

Proper  Setup  -  If  all  assigned  flight  variables  are  within  their  desired  range 
or  condition  upon  Initiating  the  maneuver,  insert  checkmark;  otherwise  mark  X. 

Proper  Timing  -  Insert  checkmark  If  timing  for  all  legs  of  a  procedure  turn, 
holding  pattern,  or  approach  Is  within  desired  limits;  otherwise  mark  X. 

Proper  Track  (ILS,  ADF)  -  Insert  checkmark  If  heading  remains  within  +2°  0f 
course  to  the  station  during  the  entire  segment;  otherwise  mark  X. 

Proper  Track  { VOR )  -  Insert  checkmark  If  the  needle  remains  within  the  dough¬ 
nut  during  the  entire  segment;  otherwise,  mark  X. 

Proper  Turn  -  Insert  checkmark  If  the  turn  Is  Initiated  and  terminated  at  the 
proper  time,  and  executed  at  the  proper  rate;  otherwise,  mark  X. 

Radio  Calls  -  Insert  checkmark  If  student  demonstrates  all  necessary  radio 
communications  prior  to  takeoff;  otherwise,  mark  X. 

Recognition  of  Attitude  -  If  student  recognizes  aircraft  attitude  upon  taking 
the  controls.  Insert  checkmark;  If  control  movements  Indicate  that  the 
aircraft  attitude  has  not  been  recognized,  mark  X. 

Report  -  Insert  checkmark  If  student  gives  accurate  and  timely  report  of  posi¬ 
tion  and  Intention  to  ATC;  If  student  forgets  to  report  or  gives  Incorrect 
Information,  mark  X. 


Reset  DG  -  Insert  checkmark  If  directional  gyro  is  reset  accurately  prior  to 
Tunfng  a  station;  otherwise  mark  X. 
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CONTROLLED  TRAINING  SYLLABI 


G-l 


CONTROLLED  TRAINING  SYLLABI 


TRACK  A 


ERAU 


COURSE 

PHASE 

LESSONS 

UNITS 

PHASE  TITLE 

FA  102-7 

I 

001-009 

001-019 

Presol o 

II 

010-014 

020-042 

Basic  Flying 

FA  103-7 

III 

015-019 

043-055 

Presolo  Cross-Country 

IV 

020-021 

056-066 

Private  Pilot 

V 

022 

067-073 

Night  Operations 

FA  203-7 

VI 

023-027 

074-087 

BAI/Radio  Navigation 

VII 

028-036 

088-118 

IFR  Operations 

FA  204-7 

VIII 

037-038 

119-128 

Advanced  Solo  Cross-Country 

IX 

039-041 

129-148 

Commercial  Maneuvers 

FA  305-7 

X 

042-045 

149-177 

Complex  Transition  (Comm) 

XI 

046-047 

178-189 

Complex  Transition  (Inst) 

G-2 


TRAINING  SYLLABUS 


General  Aviation  Trainer 


TRACK  B 


ERAU 


COURSE 

PHASE 

LESSONS 

UNITS 

PHASE  TITLE 

FA  102-8 

I 

001-009 

001-019 

Presol o 

n 

010-014 

020-042 

Basic  Flying 

FA  103-8 

in 

015-019 

043-055 

Presolo  Cross-Country 

IV 

020-021 

056-066 

Private  Pilot 

V 

022 

067-073 

Night  Operations 

FA  203-8 

VIII 

037-038 

119-128 

Advanced  Solo  Cross-Country 

VI 

023-027 

074-087 

BAI/Radlo  Navigation 

VII 

028-036 

088-118 

IFR  Operations 

FA  204-8 

IX 

039-041 

129-148 

Commercial  Maneuvers 

FA  305-8 

X 

042-045 

149-177 

Complex  Transition  (Comm) 

XI 

046-047 

178-189 

Complex  Transition  (Inst) 

G-4 


TRAINING  SYLLABUS 


ss-Country  °General  Aviation  Trainer 


CONTROLLED  TRAINING  SYLLABI 


TRACK  C 

ERAU 


COURSE 

PHASE 

LESSONS 

UNITS 

PHASE  TITLE 

FA  102-9 

I 

001-009 

001-019 

Presolo 

II 

010-014 

020-042 

Basic  Flying 

FA  103-9 

III 

015-019 

043-055 

Presolo  Cross-Country 

IV 

020-021 

056-066 

Private  Pilot 

V 

022 

067-073 

Night  Operations 

FA  203-9 

VIII 

037-038 

119-128 

Advanced  Solo  Cross-Country 

♦IX-ZULU 

039-041 

129-155 

Commercial  Maneuvers 

FA  204-9 

VI 

023-027 

074-087 

BAI/Radlo  Navigation 

VII 

028-036 

088-118 

IFR  Operations 

FA  305-9 

♦X-ZULU 

042-045 

156-185 

Complex  Transition  (Comm) 

♦All  Phases  In  each  track  are  the  same  except  IX-ZULU  and  X-ZULU. 


TRACK  C  TRAINING  SYLLABUS 


G-7/G-8  j 

. . . . . _J 


Solo  Cross-Country  General  Aviation  Trainer 
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CHECKPILOT  AND  INSTRUCTOR  BACKGROUND  DATA 


This  appendix  presents  background  data  for  the  checkpllots  and  Instructors 
used  In  the  study.  Including  age,  sex,  education,  and  flight  experience.  The 
last  of  these,  flight  experience.  Is  shown  as  total  flight  time,  total  Instru¬ 
ment  time,  total  dual  flight  time  while  Instructing,  and  total  Instrument  dual 
flight  time  while  Instructing. 


E-RAU  CHECKPILOT  BACKGROUND  DATA 


Check- 

pilot 

No. 

M 

Sex 

Education 

Total 

Time 

Instrument 

Time 

Dual 

Given 

instrument 

Dual 

Given 

1 

47 

M 

BA 

7758 

485 

4500 

3260 

2 

28 

M 

Assoc 

5980 

495 

4900 

2670 

3 

37 

M 

BS 

3500 

225 

2800 

1000 

4 

36 

M 

BS 

3200 

150 

2660 

1060 

5 

40 

M 

- 

1980 

168 

1660 

1000 

6 

42 

M 

PhD 

5300 

356 

3570 

1420 

7 

58 

M 

BS 

6795 

1150 

930 

380 

8 

48 

M 

BS 

7300 

1033 

2650 

820 

! 
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E-RAU  INSTRUCTOR  BACKGROUND  DATA 


Instruc¬ 

tor 

No.  Age 

Sex 

Education 

Total 

Time 

Instrument 

Time 

Dual 

Given 

Instrument 

Dual 

Given 

1 

21 

F 

BS 

600 

50 

370 

30 

2 

23 

M 

BS 

912 

40 

660 

153 

3 

21 

M 

Aero  Sc 

1300 

80 

800 

350 

4 

26 

M 

- 

1550 

73 

1110 

500 

5 

23 

M 

BS 

1330 

104 

1000 

350 

6 

21 

M 

Aero  Sc 

850 

120 

480 

180 

7 

22 

M 

Aero  Sc 

1000 

165 

700 

350 

8 

25 

M 

BS 

3100 

110 

2220 

400 

9 

21 

M 

BS 

440 

60 

170 

90 

10 

27 

M 

- 

1400 

100 

900 

200 

11 

23 

M 

- 

2300 

190 

1700 

700 

12 

22 

F 

BS 

1400 

400 

1000 

600 

13 

23 

M 

BS 

1100 

90 

800 

350 
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APPENDIX  I 


INSTRUMENT  DAILY  PROGRESS  RECORD  (DPR)  PERFORMANCE  CURVES 


This  appendix  presents  data  comparing  daily  performance  during  instrument 
training  of  the  three  groups  (tracks)  of  students  who  completed  the  experi¬ 
ment.  Data  points  are  group  means  for  given  successive  days  during  training. 
The  group  means  are  based  in  turn  on  means  for  individual  subjects  on  separate 
measures  comprising  maneuvers. 

The  first  set  of  curves  is  for  average  performance  of  groups  on  all  maneuvers 
that  were  evaluated  on  the  successive  days.  The  remaining  sets  of  curves  are 
for  the  separate  13  maneuvers  on  the  same  days. 

As  pointed  out  in  the  section  on  Method  in  the  text,  and  again  at  the  end  of 
the  Results  section,  these  data  do  not  permit  an  immediate  interpretation  of 
comparative  performance  of  the  three  groups,  or  even  of  a  single  group  with 
itself  on  successive  days,  because  of  inconsistencies  in  maneuvers  represented 
on  separate  days.  The  reader  should  refer  to  these  two  sections  of  the  text 
before  attempting  an  interpretation. 
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FIGURE  1-2. -STRAIGHT  AND  LEVEL. 
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FIGURE  1-3.— AIRSPEED  CHANGE. 
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FIGURE  1-4.-180°  INSTRUMENT  TURN. 
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FIGURE  1-5.  — CLIMB/DESCENT. 
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FIGURE 
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FIGURE  1-7. — ADF  PROCEDURES 
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FIGURE  1-8.  — ILS  PROCEDURES. 
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FIGURE  I- 10. -HOLDING. 
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FIGURE  1-11. — PROCEDURE  TURN. 
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FIGURE  1-14.— UNUSUAL  ATTITUDE  RECOVERY. 
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APPENDIX  J 


RELATIONSHIP  OF  PPDR  ERROR  AND  MANEUVER  LETTER  GRADES 


The  following  graphical  presentations  treat  the  PPDR  percent  error  scores  and 
the  average  maneuver  letter  grade  scores  for  both  the  Contact  and  Instrument 
Checkrldes. 

The  PPDR  error  percentage  was  derived  by  dividing  the  number  of  PPDR  measures 
for  which  tolerance  limits  were  exceeded  by  the  total  number  of  measures  on 
the  PPDR  and  multiplying  by  100.  Letter  grades  were  scaled  by  assigning  4 
points  for  an  A  grade,  3  for  a  B,  2  for  a  C,  1  for  a  D,  and  0  for  an  F,  then 
summing  these  values  across  all  maneuvers  performed  on  the  checkrlde  and 
dividing  by  that  number  of  such  maneuvers.  Greater  proficiency  Is  therefore 
Indicated  by  lower  PPDR  error  percentages  and  by  higher  scaled  letter  grades 
on  maneuvers. 

Figure  J-l  depicts  mean  percent  error  scores  for  each  training  track  (A,  B, 
and  C)  separately  for  the  Contact  Checkrlde  and  the  Instrument  Checkrlde. 
Also  shown  are  the  ±1  standard  deviation  ranges  about  those  means  for  each 
group,  and  the  overall  mean  for  each  checkrlde  with  all  groups  combined 
(Overall  Contact  Mean  a  21.58%;  Overall  Instrument  Mean  »  19.75%).  As  can  be 
seen.  Tracks  A  and  B  performed  about  equally  well  and  slightly  better  than 
Track  C  on  both  checkrldes.  However,  these  differences  were  not  statistically 
significant. 

Figure  J-2  is  a  presentation  similar  to  J-l,  except  it  shows  the  mean  maneuver 
grade  for  each  track  on  the  two  checkrldes.  Also  shown  are  the  tl  SD  ranges 
for  each  group  and  the  overall  mean  letter  grade  for  each  checkrldeTor  com¬ 
bined  groups  (Overall  Contact  Mean  =  2.24;  Overall  Instrument  Mean  =  2.07). 
It  should  be  noted  that.  In  contrast  to  the  PPDR  percent  error,  the  higher 
mean  maneuver  letter  grades  denote  better  performance  than  do  lower  grades. 
Again,  Tracks  A  and  B  performed  In  highly  similar  fashion  and  somewhat  better 
than  did  Track  C.  The  differences  were  not  statistically  significant  for  the 
Contact  Checkrlde,  but  those  for  the  Instrument  Checkrlde  were  significant 
beyond  the  .05  level. 

The  data  plots  In  Figures  J-3  through  J-8  depict  the  overall  relationship  be¬ 
tween  objective  (PPDR)  measures  and  subjective  assessments  as  represented  by 
checkpl lot- assigned  letter  grades  for  combined  maneuvers  on  the  Contact  and 
Instrument  Checkrldes.  Each  data  point  represents  the  performance  of  one  stu¬ 
dent.  Coordinates  for  each  data  point  reflect  that  student's  overall  PPDR 
error  percentage  for  the  checkrlde  plotted  against  the  mean  of  his  scaled 
maneuver  letter  grades. 


J-l 


An  examination  of  the  overall  pattern  of  data  points  can  reveal  the  general 
nature  and  magnitude  of  correlation  between  the  variables  of  interest.  In  the 
present  case,  the  data  plots  show  that  correlations  between  PPDR  error  percen¬ 
tage  and  maneuver  letter  grades  were  negative.  That  is,  low  PPDR  error  per¬ 
centages  tended  to  be  associated  with  high  maneuver  letter  grades  and  vice 
versa.  To  determine  the  degree  of  this  association,  it  is  necessary  to  com¬ 
pute  a  correlation  coefficient  (rO ,  a  numerical  value  which  ranges  from  -1.00 
(perfect  negative  correlation)  to  +1.00  (perfect  positive  correlation)  and 
represents  the  strength  of  association  between  sets  of  paired  data.  Higher 
values  of  £,  regardless  of  whether  they  are  positive  or  negative,  correspond 
to  greater  degree  of  correlation  between  variables. 

As  shown  in  each  of  the  data  plots  in  Figures  J-3  through  J-8,  the  r  values 
for  the  three  track  groups  ranged  between  -.66  and  -.78  for  the  contact 
checkride  and  between  -.78  and  -.83  for  the  Instrument  checkrlde.  Combining 
the  tracks  into  one  large  grouping  yielded  a  correlation  of  -.71  for  the 
Contact  Checkride  and  -.80  for  the  Instrument  Checkride.  All  of  these  coef¬ 
ficients  for  individual  and  combined  tracks  are  statistically  significant 
beyond  the  .01  level  (Appendix  C). 

The  data  plots  show  that  skilled  checkride  performance  as  judged  by  the  check- 
pilots  was  associated  with  relatively  low  PPDR  error  percentages.  Further, 
assigned  letter  grades  indicative  of  less  proficiency  were  accompanied  by 
fairly  linear  increments  in  PPDR  errors.  It  can  be  concluded  that  the  overall 
relationship  between  objective  measures  and  subjective  assessments  employed  in 
this  study  was  a  strong  one. 
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FIGURE  0-3. -SCATTER  DIAGRAM  FOR  PPDR  PERCENT  ERROR  AND  MEAN  MANEUVER 
LETTER  GRADE  FOR  CONTACT  CHECKRIDE  FOR  TRACK  A. 
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FIGURE  J-4.- -SCATTER  DIAGRAM  FOR  PPDR  PERCENT  ERROR  AND  MEAN  MANEUVER 
LETTER  GRAOE  FOR  CONTACT  CHECK RIDE  FOR  TRACK  B. 


FIGURE  J-5. —SCATTER  DIAGRAM  FOR  PPDR  PERCENT  ERROR  AND  MEAN  MANEUVER 
LETTER  GRADE  FOR  CONTACT  CHECKRIDE  FOR  TRACK  C. 
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FIGURE  J-6.~ SCATTER  DIAGRAM  FOR  PPDR  PERCENT  ERROR  AND  MEAN  MANEUVER 
LETTER  GRADE  FOR  INSTRUMENT  CHECKRIDE  FOR  TRACK  A. 
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FIGURE  J-7.— SCATTER  DIAGRAM  FOR  PPDR  PERCENT  ERROR  AND  MEAN  MANEUVER 
LETTER  GRADE  FOR  INSTRUMENT  CHECKRIDE  FOR  TRACK  B. 
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FIGURE  J-8.- -SCATTER  DIAGRAM  FOR  PPDR  PERCENT  ERROR  AND  MEAN  MANEUVER 
LETTER  GRADE  FOR  INSTRUMENT  CHECKRIDE  FOR  TRACK  C 


